-- Logs begin at Thu 2022-09-01 04:29:48 UTC, end at Thu 2022-09-01 05:26:42 UTC. -- Sep 01 04:55:49.179116 dv-cinder-853910-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 01 04:55:49.187211 dv-cinder-853910-6-smb devstack@keystone.service[81619]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 1 04:55:49 2022] *** Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: nodename: dv-cinder-853910-6-smb Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: machine: x86_64 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: clock source: unix Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: pcre jit disabled Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: detected number of CPU cores: 4 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: current working directory: / Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: detected binary path: /usr/bin/uwsgi-core Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: your processes number limit is 47680 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: your memory page size is 4096 bytes Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: detected max file descriptor number: 2048 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: lock engine: pthread robust mutexes Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: thunder lock: enabled Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 01 04:55:49.191432 dv-cinder-853910-6-smb devstack@keystone.service[81619]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 01 04:55:49.230171 dv-cinder-853910-6-smb devstack@keystone.service[81619]: Python main interpreter initialized at 0x55df000e39c0 Sep 01 04:55:49.230171 dv-cinder-853910-6-smb devstack@keystone.service[81619]: python threads support enabled Sep 01 04:55:49.230171 dv-cinder-853910-6-smb devstack@keystone.service[81619]: your server socket listen backlog is limited to 100 connections Sep 01 04:55:49.230171 dv-cinder-853910-6-smb devstack@keystone.service[81619]: your mercy for graceful operations on workers is 90 seconds Sep 01 04:55:49.230540 dv-cinder-853910-6-smb devstack@keystone.service[81619]: mapped 403077 bytes (393 KB) for 2 cores Sep 01 04:55:49.230540 dv-cinder-853910-6-smb devstack@keystone.service[81619]: *** Operational MODE: preforking *** Sep 01 04:55:49.230815 dv-cinder-853910-6-smb devstack@keystone.service[81619]: *** uWSGI is running in multiple interpreter mode *** Sep 01 04:55:49.230815 dv-cinder-853910-6-smb devstack@keystone.service[81619]: spawned uWSGI master process (pid: 81619) Sep 01 04:55:49.230997 dv-cinder-853910-6-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 01 04:55:49.233679 dv-cinder-853910-6-smb devstack@keystone.service[81619]: spawned uWSGI worker 1 (pid: 81632, cores: 1) Sep 01 04:55:49.233955 dv-cinder-853910-6-smb devstack@keystone.service[81619]: spawned uWSGI worker 2 (pid: 81633, cores: 1) Sep 01 04:55:49.234106 dv-cinder-853910-6-smb devstack@keystone.service[81619]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 01 04:55:53.580997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:55:53.580997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Sep 01 04:55:53.581820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:55:53.581820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Sep 01 04:55:53.582050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:55:53.582050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Sep 01 04:55:53.582497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 01 04:55:53.582497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Sep 01 04:55:53.632098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:55:53.632288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:55:53.632468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] command line args: [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:55:53.632736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:55:53.632912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ================================================================================ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:55:53.633165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.633438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_dir = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.633628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.633810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_source = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.633956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 01 04:55:53.634035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] debug = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.634155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 01 04:55:53.634233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.634416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] command line args: [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 01 04:55:53.634538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.634620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 01 04:55:53.634693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.634799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ================================================================================ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 01 04:55:53.634930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_dir = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_config_append = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_source = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.635907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] debug = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_dir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.636710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_config_append = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.637957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_dir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.638925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.639945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] publish_errors = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.640963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] standard_threads = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.641989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.43/identity {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] publish_errors = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_journal = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_json = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_stderr = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.642956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_syslog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] standard_threads = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.643652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.643895 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.643981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.644074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.644149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.644254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_journal = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.644372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.644447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_json = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.644594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_stderr = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.644675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.644772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_syslog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.644846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 01 04:55:53.645089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.645855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.646982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.647879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.648823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.649965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.650965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.651996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.652932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.653874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.654946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.655946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.656873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.657986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.658996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.659929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.660886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.661847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.662963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.663044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.663199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.663773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.663966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.664940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.665958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.666896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.667962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.668988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.external = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.669948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.password = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.token = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.670901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.671998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.external = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.672983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.password = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.token = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.673964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.674932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.675906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.676873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.677869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.678853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.679597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.679681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.679851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.680974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.681983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.682996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.683967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.684922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.685878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.686997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.687952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.688969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.689938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.690883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.691985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.692999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.693978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.694853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.695996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.696978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.697940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.698901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.699999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.700974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.701972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.702940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.703966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.704998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.705920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.706875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.707987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.708987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.709989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.710651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.710744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.711066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.711151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.711526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.711613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.711914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.712909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.713889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.714842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.715949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.716969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.717990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.718938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.719968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.720933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.721912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.722070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.722148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.722242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:55:53.722322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.722566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.722835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.723098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.723351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.723601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.723841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.724083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.724320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.724561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.724799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.725037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.725314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.725554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.726356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.726809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.727148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.727399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.727655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.727893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.728142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.728383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 01 04:55:53.728558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 01 04:55:53.752425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.752646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.752865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.755070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.755309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.755540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.761447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.765375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.790610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.790818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.792910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.793147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.844821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.845021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.894571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.894805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.895724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:53.895964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.052837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.053107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.053311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.053514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.053657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.053797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.054469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.054617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.054751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.054951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.055303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.055530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.078897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.079818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.090725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.091077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.104144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.104328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.104567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.104713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.104854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.105828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.106070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 01 04:55:54.123066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.123276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 04:55:54.123490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.123623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.123765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 04:55:54.123896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 04:55:54.124073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.124284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.124426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.124557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 01 04:55:54.124685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.124814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.124942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.125078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.125290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.125554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.134452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.134733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.135004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.135202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.135334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.135489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.135769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.136062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.142452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.143302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.145343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.145631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.145915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.146199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.146328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.146484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.146613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.146746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.146880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.147833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.148124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.148256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.148478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.148766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.149055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.149359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.171610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.172617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.173061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.173370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.174115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.174401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.177865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.178153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.178437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.179754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.180206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.180496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.185675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.185964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.186849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.187141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.190304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.190817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.191116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.191211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.191410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.191501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.191688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.191771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.192124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.192411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.192700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.192989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.193303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.193638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.193932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.194225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.210237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.210523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.210863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.211145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.214391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.215168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.217496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.217795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.218282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.218583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.222117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.222783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.225244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.226828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.229121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.229472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.229800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.230091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.230383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.230646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.230767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.231006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.231461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.231755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.232065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.232472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.248070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.248361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.248632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.248902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.249126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.249448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.249725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.250007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.255633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.256832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.257614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.258720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.259149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.259433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.260288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.260571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.262356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.262644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.262930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.263216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.263514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.263596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.263893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.264194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.264484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.264776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.274814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.275101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.275387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.275671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.275957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.276236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.276451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.276542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.276759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.277050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.277364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.277654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.277948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.278242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.292355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.295396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.295513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.298280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.298446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.299726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.301204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.301347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.301502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.301795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.302917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.305320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.305622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.305913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.308853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.310356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.312374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.313248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.313544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.313832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.314017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.314101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.316901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.317216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.317512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.317793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.322236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.322539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.322825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.326036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.326341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.326626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.329682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.329968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.330252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.330532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.330808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.331084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.331378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.331658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.331940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.332208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.332477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.332737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.333013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.333315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.333450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 01 04:55:54.333667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.333954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.334233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.334509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.334783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.335107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.335523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.336102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.336388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.336683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.336956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.337252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.337531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 01 04:55:54.367980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df000e39c0 pid: 81633 (default app) Sep 01 04:55:54.371438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6039cbf-3b70-4467-bbd2-80e3b6a5dd02 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:55:54.371729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6039cbf-3b70-4467-bbd2-80e3b6a5dd02 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:55:54.372001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6039cbf-3b70-4467-bbd2-80e3b6a5dd02 None None] PATH_INFO: `/v3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:55:54.372573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55df000e39c0 pid: 81632 (default app) Sep 01 04:55:54.376182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1/1] 10.222.0.43 () {50 vars in 791 bytes} [Thu Sep 1 04:55:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:00.901074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:00.901634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:00.901634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:00.906052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1/2] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:00 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:00.911765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:00.912335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:00.912335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:00.983870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: INFO dbcounter [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] Registered counter for database keystone Sep 01 04:56:01.004693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG oslo_db.sqlalchemy.engines [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:56:01.011981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writer thread running {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:56:01.190462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81633) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 04:56:01.190758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81633) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 04:56:01.248211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:01.249824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:01.377325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 2/3] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:00 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 466 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 04:56:01.800711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:01.870585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: INFO dbcounter [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] Registered counter for database keystone Sep 01 04:56:01.891687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG oslo_db.sqlalchemy.engines [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 01 04:56:01.897821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writer thread running {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 01 04:56:02.015369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356a8051-4d8a-47fe-82f6-bca8848e0076 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:02.019575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:02.020203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:02.020479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:02.020748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:02.029220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:02.080259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING keystone.common.rbac_enforcer.enforcer [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 04:56:02.080547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ab7550-ef82-4a56-b98f-2e261005afb8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:02.090712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 2/4] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Sep 1 04:56:01 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:02.099511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:02.113260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec1880-738d-4a51-a8fd-b37a4ca4f8d8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:02.117637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:02.118726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:02.119007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:02.119276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] PATH_INFO: `/v3/projects/9091867b04ed42e18d85ad30e6815c4c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:02.120823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] RBAC: Authorizing `identity:get_project(project_id=9091867b04ed42e18d85ad30e6815c4c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:02.173282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING keystone.common.rbac_enforcer.enforcer [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 01 04:56:02.173623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9effcf-03e3-4fd8-bf14-83d8af0f75d0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:02.178660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 3/5] 10.222.0.43 () {56 vars in 1207 bytes} [Thu Sep 1 04:56:02 2022] GET /identity/v3/projects/9091867b04ed42e18d85ad30e6815c4c => generated 344 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:04.058904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ac51-26ef-4531-a137-d1b07607a8fc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:04.059434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ac51-26ef-4531-a137-d1b07607a8fc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:04.059434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d8ac51-26ef-4531-a137-d1b07607a8fc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:04.063565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 3/6] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:04.069544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:04.069966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:04.070089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:04.090602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:04.092087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:04.099878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 4/7] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:04 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 01 04:56:04.375215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8ac51-26ef-4531-a137-d1b07607a8fc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:04.388109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d8ac51-26ef-4531-a137-d1b07607a8fc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:04.392257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:04.392856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:04.393143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:04.393448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:04.400959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:04.402762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26ba4d8-7132-4aff-9dc3-fae1adfe36f0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:04.411348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 4/8] 10.222.0.43 () {58 vars in 1324 bytes} [Thu Sep 1 04:56:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 04:56:04.416693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:04.425593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ef062b-b590-4b4c-a7cc-dbcb1084964b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:04.430380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:04.430995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:04.431271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:04.431539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:04.432839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:04.434678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c8db8-98aa-4fb7-ac60-eb1e31451d60 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:04.436177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 5/9] 10.222.0.43 () {56 vars in 1198 bytes} [Thu Sep 1 04:56:04 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:06.407684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540933-9ebb-49b8-9537-aa7aba27e294 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:06.408224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540933-9ebb-49b8-9537-aa7aba27e294 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:06.408224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6540933-9ebb-49b8-9537-aa7aba27e294 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:06.409571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 5/10] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:06.414848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:06.415277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:06.415399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:06.420739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a88b-1835-41d3-8f08-4ea167cd1139 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:06.421024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a88b-1835-41d3-8f08-4ea167cd1139 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:06.421337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6851a88b-1835-41d3-8f08-4ea167cd1139 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:06.422577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 6/11] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:06.428117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:06.428509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:06.428671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:06.433997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:06.435149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:06.470268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81632) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 01 04:56:06.470651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81632) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 01 04:56:06.513307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 6/12] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:06.519644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:06.521906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:06.619656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 7/13] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:06.780974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:06.805376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:06.885054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419e8db7-c3ec-4e50-a59d-85fc375db450 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:06.886903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:06.918795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:06.919422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:06.919701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:06.919969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:06.931084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:06.940017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:06.941171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:06.942050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:06.945715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 7/14] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:06.948045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:06.992871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-150156c6-a6ef-465c-943d-f4bbe3c0a824 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:06.995572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.030015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.032596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.033445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.033734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.034014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.048605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa359b3-1439-4933-9b58-a6054ddc135c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.081750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.082357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.082640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.082915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.084173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:07.084491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.085910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.097591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 8/15] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:07.102030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.103622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.103734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:07.200050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 8/16] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:07.200468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcfbb66-e670-47a3-ad61-4726fe5e510e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.205579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:07.208298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.236053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.236683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.236962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.237262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.238391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.239861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.241456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 9/17] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:07 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:07.247303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:07.263308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.306056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81ac03c-e75a-49c8-945c-ea4fe4efbd5e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.338736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.339580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.339862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.340139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.346587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927c8e7b-54e6-45f0-8c9d-18eeb3594ca2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.358249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.359717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:56:07.378076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:07.379139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:56:07.380143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:56:07.380143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:56:07.380143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:07.380143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 9/18] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:07.383009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.383642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.383922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.384194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.385705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.386143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:07.387267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.388808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 10/19] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:07.394515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:07.447562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.473942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:07.493159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760519e-3dda-4355-871e-c6c5f83c57de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.494426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5806a69-b708-4348-ba2d-b427c33b5407 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:07.526577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.527220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.527504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.527668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:07.527769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.528266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:07.528415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:07.528543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:07.528723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.528813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:07.529547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.domain.id=default, user.id=cf343adbeb5a4274998fc6f26d67b66f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:07.529852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:07.530130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b466098-30de-4bc7-96c6-aca2308b83ab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.531254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4b560-2711-4dbe-89a4-9d7477c0271d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:07.537926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 11/20] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Sep 1 04:56:07 2022] GET /identity/v3/role_assignments?user.id=cf343adbeb5a4274998fc6f26d67b66f&scope.domain.id=default&role.id=735711bc5949482f97472a303cdeab41 => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:07.552061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 10/21] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:56:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:09.536831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bebdd0-fa5d-4bd2-8945-d3f62bee7007 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:09.537394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bebdd0-fa5d-4bd2-8945-d3f62bee7007 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:09.537656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bebdd0-fa5d-4bd2-8945-d3f62bee7007 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:09.539372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 12/22] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:09.544391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffaa90-3f74-4cab-8d11-b00d30faf2e2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:09.544802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffaa90-3f74-4cab-8d11-b00d30faf2e2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:09.544982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ffaa90-3f74-4cab-8d11-b00d30faf2e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:09.574175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-48ffaa90-3f74-4cab-8d11-b00d30faf2e2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:09.575377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-48ffaa90-3f74-4cab-8d11-b00d30faf2e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:09.657536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 11/23] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:09.937558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5663e-03dd-4a88-a717-3ed07cb7ca0d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:09.937941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5663e-03dd-4a88-a717-3ed07cb7ca0d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:09.938115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f5663e-03dd-4a88-a717-3ed07cb7ca0d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:09.939436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 13/24] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:09.949603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1bb16-6850-4305-9330-18189465b817 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:09.950119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1bb16-6850-4305-9330-18189465b817 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:09.950589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b1bb16-6850-4305-9330-18189465b817 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:09.973559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-21b1bb16-6850-4305-9330-18189465b817 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:09.975303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-21b1bb16-6850-4305-9330-18189465b817 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:10.030736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:10.066533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 12/25] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:10.091376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46072f8-6210-41d5-9fbb-d86058bcf163 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.091968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46072f8-6210-41d5-9fbb-d86058bcf163 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.092456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46072f8-6210-41d5-9fbb-d86058bcf163 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.094016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 14/26] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:10.099528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.100072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.100554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.125337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:10.126877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:10.184019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46072f8-6210-41d5-9fbb-d86058bcf163 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:10.235254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 13/27] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:10.359270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46072f8-6210-41d5-9fbb-d86058bcf163 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:10.425243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:10.425898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.426177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.426448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.445149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3a5b6bf9-1b93-4dd6-9531-c8decfd55b50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:10.450684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:10.451556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:10.452742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 15/28] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:10.459706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:10.515826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cca2-e1e3-4c2b-a36e-ee412ff9258b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.516315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cca2-e1e3-4c2b-a36e-ee412ff9258b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.516795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab2cca2-e1e3-4c2b-a36e-ee412ff9258b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.519818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 16/29] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:10 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:10.526491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.527064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.527575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.552426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:10.571669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:10.575162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:10.646403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ea6d96-268f-4d55-92cc-1d6e2a1937a8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:10.660952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:10.701734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 17/30] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:10.703007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:10.719574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:10.721026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.727394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.727951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.728855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:10.730032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:10.734413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:10.770227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 14/31] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:10.771454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:10.885612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c21be5a-d771-4f90-8213-015794461a3e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:10.959323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:10.960261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:10.960861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:10.961368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:10.963911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:10.974125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:10.976285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:56:11.002378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:11.003320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:56:11.004127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:56:11.004127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:56:11.004127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:11.004127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 18/32] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:11.004351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.017612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b04692-b371-43a3-b5b5-58f46d818bd8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.053411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.054351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.054830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.055342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.056314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.057941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.128945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85108da4-fd9d-4b83-a72c-7da808fece1e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.182435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.183336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.183763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.184185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.185562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.187174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.188944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 19/33] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:11 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:11.189890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.205109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 15/34] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 04:56:10 2022] POST /identity/v3/roles => generated 219 bytes in 434 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:11.206780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.256470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:11.266575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:11.321177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4074e56d-9066-42c3-95da-c347f68ee3a6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.362334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.363092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.363459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.363766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.364723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.366252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.372155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a964bd-9365-4bd2-b852-c32c93bcf256 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.416771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.417781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.418270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.418765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.419622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:11.420099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.421983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.435939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 16/35] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:11.437212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.500379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 20/36] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 04:56:11 2022] POST /identity/v3/roles => generated 225 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:11.501672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.544811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:11.562732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf06c2c-5ad2-410d-aabb-8d48f9bb68bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.609797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.610805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.611305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.611774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.614732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.616467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151619c-9dc9-41fd-8133-665144943e2d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.618826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 17/37] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:11.620383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dbd0-5736-47c9-8703-9df7f7d2f48c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.620871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dbd0-5736-47c9-8703-9df7f7d2f48c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.625775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f6dbd0-5736-47c9-8703-9df7f7d2f48c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.627609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 18/38] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:11 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:11.629497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6dbd0-5736-47c9-8703-9df7f7d2f48c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:11.653974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6c2509-bc6b-48aa-91b9-c057640fbe1c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.671639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:11.696386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.697672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.698200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.698733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.699727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.701707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025a959-5a3c-4d80-8176-bd0bfb2369db None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.740838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 21/39] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:56:11 2022] POST /identity/v3/projects => generated 301 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:11.743103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.743550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.743834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.748094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f6dbd0-5736-47c9-8703-9df7f7d2f48c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:11.764545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:11.766156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:11.791291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:11.792256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.792699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.792981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] PATH_INFO: `/v3/domains/default/users/cf343adbeb5a4274998fc6f26d67b66f/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.796479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=cf343adbeb5a4274998fc6f26d67b66f, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:11.800039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bfdaf-df7e-41b8-869e-116f37e8f014 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:11.816760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 19/40] 10.222.0.43 () {58 vars in 1361 bytes} [Thu Sep 1 04:56:11 2022] PUT /identity/v3/domains/default/users/cf343adbeb5a4274998fc6f26d67b66f/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:11.818848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3cc6-efe4-432d-a477-25ba20240f4a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.819140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3cc6-efe4-432d-a477-25ba20240f4a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.819476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957a3cc6-efe4-432d-a477-25ba20240f4a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.821041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 20/41] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:11.830724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:11.831061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:11.831280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:11.858798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:11.861391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:11.879009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:11.879391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 22/42] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:11.961864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 21/43] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:12.151218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:12.236303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:12.249490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:12.258319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe379ee9-d608-4a98-b00a-b63d9ee6e39d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:12.353165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9088e3ab-23bf-4002-9833-daf777d2858c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:12.393171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:12.394532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:12.394966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:12.395670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:12.397158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:12.398788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:12.400521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 22/44] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:12.402847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:12.403405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:12.403686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:12.403961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:12.404640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:12.407108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92271e0e-a9b1-46f4-9712-dbc5e2eec5f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:12.408107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:12.424499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 23/45] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 04:56:12 2022] POST /identity/v3/roles => generated 223 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:12.425693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:12.524110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d2668e-b00a-464c-82e9-cd6bb8d84f5f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:12.561643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:12.562571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:12.562847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:12.563128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:12.563795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:12.565305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca4455f-432f-4915-8a88-24a3a0b287cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:12.597030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 23/46] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:56:12 2022] POST /identity/v3/projects => generated 312 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:13.766656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec6fb7-1a60-4eaa-9c67-d4453a7cb2a0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:13.767166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec6fb7-1a60-4eaa-9c67-d4453a7cb2a0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:13.767272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bec6fb7-1a60-4eaa-9c67-d4453a7cb2a0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:13.768688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 24/47] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:13.773957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:13.774324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:13.774635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:13.793095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:13.794313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:13.851125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:13.859482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 24/48] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:14.128694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec6fb7-1a60-4eaa-9c67-d4453a7cb2a0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:14.226819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bec6fb7-1a60-4eaa-9c67-d4453a7cb2a0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:14.259940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:14.260568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.260849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.261122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.270964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:14.275748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:14.276679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:14.277491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 25/49] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:14.282800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:14.378682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fcfd34-8e7c-4967-8512-a8b6f48af1e6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:14.413446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:14.413981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.414258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.414533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.415194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:14.415497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:14.416867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2680897-02d2-4fa6-9b41-61b417f9b804 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:14.424913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 25/50] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:14.431125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:14.449868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:14.517581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb6fa-15d4-4117-9cf2-f49f681bd217 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.517873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb6fa-15d4-4117-9cf2-f49f681bd217 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.518160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bb6fa-15d4-4117-9cf2-f49f681bd217 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.519502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 26/51] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:14.524403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.524691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.524970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.531010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de18877-287b-4ce8-89c6-6f40edca7ba3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:14.567240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:14.567900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.568184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.568463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.569703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:14.571225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:14.572870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 26/52] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:14.578744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:14.649430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:14.650655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:14.665080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:14.681067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e75e67-58e8-41ba-b9af-203abed0daeb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:14.703065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:14.714825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:14.715457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.715741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.716018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.717127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:14.717430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 27/53] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:14.718615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:14.720303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 27/54] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:14.727702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:14.823293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b1804-27d7-4109-bd8f-a7c88a43a8d4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:14.855114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:14.855709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:14.855985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:14.856257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:14.856973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.domain.id=default, user.id=cf343adbeb5a4274998fc6f26d67b66f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:14.857308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:14.858724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:14.866887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 28/55] 10.222.0.43 () {56 vars in 1322 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/role_assignments?user.id=cf343adbeb5a4274998fc6f26d67b66f&scope.domain.id=default&role.id=735711bc5949482f97472a303cdeab41 => generated 530 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:14.992833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:15.098280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1633f7a0-9099-4378-89cb-3d8577c938ae None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:15.132883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:15.133539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:15.133826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:15.134100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:15.135462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:15.136893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beede5dc-f838-4c4b-aa63-3e4b50ae8c9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:15.138501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 28/56] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:15.144057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:15.195532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:15.240451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ade840a-4829-4730-a532-b50416f79393 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:15.273351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:15.273961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:15.274244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:15.274527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:15.275179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:15.276617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a67056-3c66-419d-86bf-4f41bf0476a7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:15.300659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 29/57] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Sep 1 04:56:15 2022] POST /identity/v3/projects => generated 298 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:17.198517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937817-bd80-4679-8d46-c4cd78d80d4f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:17.198999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937817-bd80-4679-8d46-c4cd78d80d4f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:17.198999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f937817-bd80-4679-8d46-c4cd78d80d4f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:17.200313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 29/58] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:17.205681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:17.206061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:17.206244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:17.224094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:17.225306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:17.289700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 30/59] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:17.555168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937817-bd80-4679-8d46-c4cd78d80d4f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:17.577087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:17.655029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f937817-bd80-4679-8d46-c4cd78d80d4f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:17.687736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:17.688357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:17.688637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:17.688913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:17.690044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:17.691472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68dabb4-ed00-4bfc-930b-2c460fd5a22f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:17.693586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 30/60] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:17.699014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:17.730756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:17.795443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec204274-1910-4d3f-9f09-379cc2e3d11d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:17.828580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:17.829120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:17.829427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:17.829705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:17.830352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:17.831789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df78bc8-f845-431d-ad44-ea97d1369398 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:17.857486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 31/61] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:17 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:20.846180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000285ab-3238-447b-86ae-609314702b99 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:20.847189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000285ab-3238-447b-86ae-609314702b99 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:20.848300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000285ab-3238-447b-86ae-609314702b99 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:20.849927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 31/62] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:20.855251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351cab5-6b8a-4da0-8b60-77fdded62c75 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:20.855651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351cab5-6b8a-4da0-8b60-77fdded62c75 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:20.855804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351cab5-6b8a-4da0-8b60-77fdded62c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:20.882592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4351cab5-6b8a-4da0-8b60-77fdded62c75 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:20.883801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4351cab5-6b8a-4da0-8b60-77fdded62c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:20.950568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb015-9566-4cd4-8bdf-4f21430daa93 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:20.950859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb015-9566-4cd4-8bdf-4f21430daa93 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:20.951142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7cbb015-9566-4cd4-8bdf-4f21430daa93 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:20.952733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 32/63] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:20.959290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff268b7-73f6-41b9-90c4-3ee1aa378fb9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:20.959570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff268b7-73f6-41b9-90c4-3ee1aa378fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:20.959858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff268b7-73f6-41b9-90c4-3ee1aa378fb9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:20.993697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0ff268b7-73f6-41b9-90c4-3ee1aa378fb9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:20.994888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ff268b7-73f6-41b9-90c4-3ee1aa378fb9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:21.006168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 32/64] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:21.096978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 33/65] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:21.113001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ff6-4d5f-4499-b0a3-4e4dc8d9aa89 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.113408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ff6-4d5f-4499-b0a3-4e4dc8d9aa89 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.113688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43168ff6-4d5f-4499-b0a3-4e4dc8d9aa89 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.115035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 33/66] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:21.120195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.120728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.121220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.161896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:21.163477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:21.183025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.255655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 34/67] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:21.386761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43168ff6-4d5f-4499-b0a3-4e4dc8d9aa89 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.387369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.418068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.541567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43168ff6-4d5f-4499-b0a3-4e4dc8d9aa89 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:21.564858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e52cef-5b73-48a9-a527-833f9d33a9b4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:21.577364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:21.578002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.578284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.578559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.590316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-502b8515-4517-4f24-b3d6-68130e4d2a59 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:21.596623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:21.598380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:21.599233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 34/68] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:21.602564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e4cd-9c8a-4e6e-8b68-fdde6d90cc98 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.602925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:21.603293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e4cd-9c8a-4e6e-8b68-fdde6d90cc98 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.603577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.603682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e2e4cd-9c8a-4e6e-8b68-fdde6d90cc98 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.603858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.604130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.604848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 35/69] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:21.609458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e4cd-9c8a-4e6e-8b68-fdde6d90cc98 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.614393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b090bc20-c559-480e-97de-f3f7038571ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:21.619189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:21.620123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:21.620888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 35/70] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:21.622109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf77b-c90b-4d5d-9083-7ae803f2ba94 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.622207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf77b-c90b-4d5d-9083-7ae803f2ba94 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.622463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddf77b-c90b-4d5d-9083-7ae803f2ba94 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.623847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 36/71] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:21.624375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf77b-c90b-4d5d-9083-7ae803f2ba94 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.635159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.693981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.714221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e2e4cd-9c8a-4e6e-8b68-fdde6d90cc98 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:21.727644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddf77b-c90b-4d5d-9083-7ae803f2ba94 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:21.747010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:21.747643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.747931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.748210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.759541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:21.761618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:21.762224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.762502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.762775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.763436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:21.763740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dddb2aa6-9185-4ad4-ad0a-4ebfd1503131 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:21.764413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:21.765536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:21.766490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:21.767332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:21.770866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 36/72] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:21.771946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8daf0-972a-4681-8771-ca54fa6689f7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.772238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8daf0-972a-4681-8771-ca54fa6689f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.772520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac8daf0-972a-4681-8771-ca54fa6689f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.773633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 37/73] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:21.774267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.791227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8ac8daf0-972a-4681-8771-ca54fa6689f7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:21.792145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8ac8daf0-972a-4681-8771-ca54fa6689f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:21.842074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.857340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 37/74] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:21.864808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.865090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.865399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.876527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71140e09-8df0-4ce0-9b77-b61ca7404586 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:21.883589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:21.885027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:21.912445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:21.913062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:21.913625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:21.913625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:21.914315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:21.914616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:21.915962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:21.926250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 38/75] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:21.926810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:21.953302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:21.959071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 38/76] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:21.974625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.037381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9d451b-fc4f-436a-a6e5-8ced1ac51bbe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.070440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.076883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.077735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.078206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.078645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.079553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:22.080047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.081755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.090658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 39/77] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:22.091676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.120145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e37bbc5-abad-41f9-bc0e-e51f9da7b20c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.158840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.159797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.160784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.161243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.162378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.163828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.169293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 39/78] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:21 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:22.169293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.202024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f770381-6b7b-42f6-a624-5a63737a1f59 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.237362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.237999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.238308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.238587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.240165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.252102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.253586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.255240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 40/79] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:22.256015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.275592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64db871e-47ca-4a82-a1ce-2212149e2574 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.307916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.309420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.310056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.310342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.310622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.311764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.313235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.314823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 40/80] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:22.315583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.360317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f86baef-6473-4ef0-b722-4bb65c1399d2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.395487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.396123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.396407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.396687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.397862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.399306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.400871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 41/81] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:22.401657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.417826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5b5cc-5135-464b-8c99-fef2894d68a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.453599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.454145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.454430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.454706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.458108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.498363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072e375e-ca92-4563-a435-fcd1affacc0c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.520607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.523190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.524649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.535689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.536317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.536594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.536872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.547002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:22.552041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:22.553039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:22.553852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 42/82] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:22.554483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.624808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 41/83] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:22.625680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.658830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961c6ef3-48a5-4f36-bd66-ae5cae5a3df6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.660531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.694984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.695596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.695876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.696152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.724101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55681e7e-bbe8-487b-bfd8-b15912a8fe62 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:22.742193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.756827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:22.757479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:22.757761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:22.758062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:22.762193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.763724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.823674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:22.825133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:22.858669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.860445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 43/84] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:22.861533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.923607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 42/85] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:22.924445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:22.947469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:22.968709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e3761-f316-4a91-93e6-1d201960b4b6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.004717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.005274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.005559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.005835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.006491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.007953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.031133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd5a56f-0878-4c67-afab-6836600358d7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.036459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 44/86] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:22 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:23.036459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.073207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.073880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.074168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.074447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.075132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:23.075436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.076875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.079622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.092330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 43/87] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.092330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.178169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e866a91-c963-454b-946e-a626bb68c585 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.202545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0e4dc-c793-447f-a9e0-7bc5203e84b1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.216692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.217376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.217661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.217944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.219209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.221885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.222704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 45/88] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.223590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.228276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.244550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.245225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.245508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.246262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.247417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.248864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.250737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 44/89] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.251735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.338782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.360457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641a09ee-9f7d-488b-8c7c-ae08daa54882 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.380534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783bf5f4-1cbd-4cb1-a241-aed361c1816f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.403159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.403803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.404085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.404360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.405552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.407064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.408817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 46/90] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.409610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.433848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.434472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.434801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.435075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.436218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.437750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.439636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 45/91] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.440344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.497468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.530290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db680fb3-bcca-433f-8b4e-5a936bdc32c5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.556763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589c7ebb-7aa8-4235-bb31-dfbc63238ccb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.565170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.565820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.567003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.567447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.568191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=cf343adbeb5a4274998fc6f26d67b66f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:23.568501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.570158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.575941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 47/92] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/role_assignments?user.id=cf343adbeb5a4274998fc6f26d67b66f&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.576730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.599075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.600047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.600550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.601038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.602120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:23.602638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.604292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.606723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.611967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 46/93] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=08fff9389c4141b080d31ea8280129d0 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.613390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:23.765807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be963b0e-2272-42d6-83f9-52b16acd5821 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.788436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb38e169-9c8b-4868-8fc2-3445f244ba60 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:23.829424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.830414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.830895 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.831366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.852310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:23.852874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:23.853161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:23.853463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:23.854229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:23.854547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.856041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:23.862597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.866804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 48/94] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:23.915091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:23.919504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:23.921178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:24.036597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 47/95] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:24.042902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:24.177457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7428c73a-ba01-40cb-b7c1-2f0402a027a4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:24.221614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:24.222297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:24.222590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:24.222868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] PATH_INFO: `/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:24.224074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] RBAC: Authorizing `identity:get_project(project_id=d2479a484b0d42c09ab6cec9bf1e4305)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:24.225574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977bc5d9-638f-4c18-86f4-449b5d8022e3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:24.227628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 49/96] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:24 2022] GET /identity/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305 => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:24.233671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:24.360296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:24.364332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5687cda7-3b8e-4abf-a02f-0ae9c8ce47b4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:24.410504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:24.411130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:24.411471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:24.411752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:24.412554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=d2479a484b0d42c09ab6cec9bf1e4305, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:24.412876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:24.414462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ade50ae-1dac-474d-ae6a-d509602336b3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:24.426524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 48/97] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:24 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=d2479a484b0d42c09ab6cec9bf1e4305&role.id=08fff9389c4141b080d31ea8280129d0 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:25.556823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f487e65-00e6-49a3-ab0f-3f6924ffbfb7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:25.557381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f487e65-00e6-49a3-ab0f-3f6924ffbfb7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:25.557381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f487e65-00e6-49a3-ab0f-3f6924ffbfb7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:25.559081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 50/98] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:25.564336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:25.564739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:25.564921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:25.587585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:25.588783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:25.663382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 49/99] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:26.215083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f487e65-00e6-49a3-ab0f-3f6924ffbfb7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:26.303147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:26.339600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f487e65-00e6-49a3-ab0f-3f6924ffbfb7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:26.374963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:26.375943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.376439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.376905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.389003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2c56991c-c3d3-4532-a25d-832fe6e0e01f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:26.395555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:26.396392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:26.397157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:26.399417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 51/100] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:26.410378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:26.416088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e466d-7bf9-44ed-b2fb-2b51963116a4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.416658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e466d-7bf9-44ed-b2fb-2b51963116a4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.417129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e92e466d-7bf9-44ed-b2fb-2b51963116a4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.418821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 52/101] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:26.428247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.428828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.429398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.457957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:26.459681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:26.534280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:26.549459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2093de-4169-47cf-86cc-109ba389f3e8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:26.623804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:26.624421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.624697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.624974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.625691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:26.625995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:26.627365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd7d92-6042-417b-b076-fc8feb83b56c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:26.629368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 53/102] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:26.645236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 50/103] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:26.650800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:26.716250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee44e-d85c-46e3-941d-23c93a16e8ca None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.716759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee44e-d85c-46e3-941d-23c93a16e8ca None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.717204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dee44e-d85c-46e3-941d-23c93a16e8ca None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.718689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 51/104] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:26.723843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550f7b-85ab-4019-8db0-41ec20a31ada None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.724325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550f7b-85ab-4019-8db0-41ec20a31ada None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.724762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2550f7b-85ab-4019-8db0-41ec20a31ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.743958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b2550f7b-85ab-4019-8db0-41ec20a31ada None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:26.745414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2550f7b-85ab-4019-8db0-41ec20a31ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:26.764616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:26.820275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 52/105] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:26.821851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d833-18aa-439a-b3e0-7d070b699f66 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.822349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d833-18aa-439a-b3e0-7d070b699f66 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.822841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0398d833-18aa-439a-b3e0-7d070b699f66 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.824298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 53/106] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:26.825955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1cd4-cddf-4f2d-9485-a094ea1bef38 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.826460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1cd4-cddf-4f2d-9485-a094ea1bef38 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.826993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da1cd4-cddf-4f2d-9485-a094ea1bef38 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.828840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 54/107] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:26.830177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b4a4-8dee-4d11-8739-ca7e8c486321 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.830658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b4a4-8dee-4d11-8739-ca7e8c486321 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.831201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2845b4a4-8dee-4d11-8739-ca7e8c486321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.850095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2845b4a4-8dee-4d11-8739-ca7e8c486321 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:26.851599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2845b4a4-8dee-4d11-8739-ca7e8c486321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:26.851924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37334517-4be7-4bf6-a648-3d7b8b269688 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:26.922468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:26.923139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.923420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.923691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] PATH_INFO: `/v3/users/f6ac0266f5814041a002e26688d7e667` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.934953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 55/108] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:26.936564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:26.937056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:26.937575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:26.965913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ac0266f5814041a002e26688d7e667)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:26.967414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:26.975019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 54/109] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:26 2022] GET /identity/v3/users/f6ac0266f5814041a002e26688d7e667 => generated 289 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:26.986697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:26.999157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:27.000352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:27.020849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.135501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 56/110] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:27.140726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.185085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db485e1e-662a-4937-8829-5f95f06fc134 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.201813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.219731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.220431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.220871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.221320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.250443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a26e9f-e057-495e-8d54-6d25193b84af None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.286510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.287143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.287432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.287711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.289471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:27.290961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a10d220-8664-4167-846c-7e69404c7e05 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:27.292588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 57/111] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:27.293819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a62a-0a8b-4ac7-946e-e49c32f431a4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.294115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a62a-0a8b-4ac7-946e-e49c32f431a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.294395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b1a62a-0a8b-4ac7-946e-e49c32f431a4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.295602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 58/112] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:27.296434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a62a-0a8b-4ac7-946e-e49c32f431a4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.303887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:27.305406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:27.314025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.408707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b1a62a-0a8b-4ac7-946e-e49c32f431a4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.416937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 55/113] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:27.416937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.434421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.444009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.444639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.444919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.445208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.454892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fa7fabce-2848-4246-99f2-e6b8b24ef797 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:27.460368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:27.461249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:27.462011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 59/114] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:27.462642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.462939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.463170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.481431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:27.482611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:27.518094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a22d9d4-3c7f-47cd-86a0-8fa3f59c94b6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.547081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 60/115] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:27.547722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.550016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.552746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.553431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.553753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.554031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.564221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:27.570007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:27.570865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:27.571619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 56/116] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:27.572257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.650965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.668778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1b8ac7-0b8e-4260-aaa8-bb1658f1ebd1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.676015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2e53e7-7c99-4e4a-983c-964096e8d148 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.702980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.703598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.703878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.704155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.704802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:27.706800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:27.712633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.713293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.713575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.713849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.714971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:27.716524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:27.718507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 57/117] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:27.724365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.735647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 61/118] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:56:27 2022] POST /identity/v3/projects => generated 302 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:27.736467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.815072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:27.870750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a3e274-7ee6-403f-ac02-3d8c3486a322 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.870952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400153c5-d8a2-4b1d-8e74-34726c0acd99 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:27.911242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.911861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.912140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.912412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.913686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:27.913686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:27.914796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:27.920275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:27.920865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:27.921148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:27.921457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:27.925330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 62/119] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:27.926256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.937126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:27.942704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:27.943638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:27.944439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 58/120] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:27.945084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:27.949690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.052759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33010d95-2319-46fa-a97a-5f736a8f62d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.059164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb50d39-1da3-46a1-93a6-0d3328b60872 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.069808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.090937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.091549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.091861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.092140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.093094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:28.093437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.093985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.094607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.094819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.094910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.095156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.095883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=f6ac0266f5814041a002e26688d7e667) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:28.096205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.098274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.108118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 63/121] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.108299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 59/122] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:27 2022] GET /identity/v3/role_assignments?user.id=f6ac0266f5814041a002e26688d7e667&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.108378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.108445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.194140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.220370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98f6ea0-bc92-4dd5-b8a3-1a06a51d91cf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.248556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d7707-6a1f-4e11-93ea-5296213cf4d4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.258702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.259371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.259654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.259930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.261272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.263031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.264848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 60/123] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.264848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.299226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.300685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.300976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.301305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.320938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:28.328451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:28.329351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:28.330123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:28.330696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 64/124] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:28.332611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.379533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d0fb8a-e1a5-4dd7-bbb9-c8ef1217a530 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.386763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.418333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.419110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.419507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.419792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.420476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:28.420785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.422212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.425447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.437822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 61/125] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.439411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.470135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ee5ac3-4ca1-41bd-8294-6175ea7cfd12 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.520879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.521780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.522663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.523099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.525079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.527428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.530018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 65/126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.530948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.551267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae581cdc-93f7-4dd5-8806-ea61e5a2edec None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.587904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.588548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.588830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.589167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.590337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.591806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.593758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 62/127] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.594754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.644496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72f59e4-5185-4fee-8908-bc85c8932e54 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.652584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.665820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.684748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.685982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.686639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.687093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.688009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:28.688489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.690063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.700194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 66/128] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.701301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.703411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4ce104-0b20-4369-bd32-9e6ff50c36ef None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.740432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.740612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.740796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.741079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.742283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.743814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.750066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 63/129] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.751027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.814378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82297e8-0313-4b8a-aab0-8e226f8a11cf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.851861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.852779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.853358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.853929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.855237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.856846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff22aa16-00d2-47c7-afbf-691655564cb8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:28.857109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.859164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 67/130] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:28.860285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.900248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:28.900906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:28.901225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:28.901503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/users/39a86a262916418689a8a39b9c57efca/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:28.902032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.903808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, user_id=39a86a262916418689a8a39b9c57efca, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:28.905286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:28.907882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:28.924061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 64/131] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:28 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/users/39a86a262916418689a8a39b9c57efca/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:28.925906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:28.998880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923487c5-86e2-4aa1-ae1f-4a761721abf9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.037462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.038136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.038423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.038768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.039977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.041516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.043565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 68/132] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:29.044275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:29.065112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8483671a-3925-4806-af4e-e61203853b65 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.110760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.111432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.111720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.112001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.114201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.116267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.118616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 65/133] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:28 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:29.121964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:29.182845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06cad17-cbe2-4c00-8057-d319a48e22df None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.185969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:29.195985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:29.232517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.233249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.233790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.234041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/users/39a86a262916418689a8a39b9c57efca/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.236925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, user_id=39a86a262916418689a8a39b9c57efca, role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.239950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.245600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a0ec0-c531-4e74-9b0c-95f0a085a13f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.262166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 69/134] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:29 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/users/39a86a262916418689a8a39b9c57efca/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:29.263392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:29.304491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.305576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.306035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.306555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] PATH_INFO: `/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.308257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] RBAC: Authorizing `identity:get_project(project_id=d2479a484b0d42c09ab6cec9bf1e4305)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.310988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.313960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 66/135] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:29 2022] GET /identity/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:29.321748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:29.423056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501609c2-68f4-4888-afb1-00344bd68be4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.488766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.489477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.489813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.490098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/users/cf343adbeb5a4274998fc6f26d67b66f/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.493623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, user_id=cf343adbeb5a4274998fc6f26d67b66f, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.495108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b0d388-d5a9-4bca-9c6e-48e478919bca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.517887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 70/136] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:29 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/users/cf343adbeb5a4274998fc6f26d67b66f/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:29.519074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcfda4-4feb-4e98-83fa-30f5dcaa3d07 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:29.556559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:29.557329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.557777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.558059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] PATH_INFO: `/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305/users/39a86a262916418689a8a39b9c57efca/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.561159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:29.562107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] RBAC: Authorizing `identity:create_grant(project_id=d2479a484b0d42c09ab6cec9bf1e4305, user_id=39a86a262916418689a8a39b9c57efca, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:29.563842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da5037a9-96da-4b58-a60c-8cd80e071c9f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:29.581256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 67/137] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:29 2022] PUT /identity/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305/users/39a86a262916418689a8a39b9c57efca/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 04:56:29.948954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4888c-fb23-435e-a299-ac15331278bd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.949376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4888c-fb23-435e-a299-ac15331278bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.949587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a4888c-fb23-435e-a299-ac15331278bd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.950885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 71/138] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:29.957615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:29.958051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:29.958233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:29.977689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:29.978879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:30.055960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 68/139] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:30.600630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4888c-fb23-435e-a299-ac15331278bd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:30.632022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:30.719699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a4888c-fb23-435e-a299-ac15331278bd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:30.754861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:30.755550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:30.755830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:30.756100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:30.757280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:30.758989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d298dc-bb01-4dfd-90e9-c3a99b41cd9e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:30.760622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 72/140] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:30.766076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:30.866220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0da33a-9e94-4510-8424-bbaa2cfabd60 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:30.886871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:30.900791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:30.901690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:30.902011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:30.902318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:30.903140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:30.904703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32216c6-e5f4-4915-8f72-7d7267a7067b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:30.932039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 69/141] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:30 2022] POST /identity/v3/users => generated 283 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:30.938949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa815-523f-4b6d-b4ab-87757c46feaa None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:30.939236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa815-523f-4b6d-b4ab-87757c46feaa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:30.939571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7aa815-523f-4b6d-b4ab-87757c46feaa None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:30.941928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 73/142] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:30.951126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264223b-ed8f-4555-a5ab-d880c7810387 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:30.951414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264223b-ed8f-4555-a5ab-d880c7810387 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:30.951810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1264223b-ed8f-4555-a5ab-d880c7810387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:30.978585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1264223b-ed8f-4555-a5ab-d880c7810387 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:30.979915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1264223b-ed8f-4555-a5ab-d880c7810387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:31.074199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 70/143] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:31.633318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410db55-62bd-4d9e-a5f0-6715f48afc44 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:31.633814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410db55-62bd-4d9e-a5f0-6715f48afc44 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:31.633886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410db55-62bd-4d9e-a5f0-6715f48afc44 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:31.635456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 74/144] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:31.640642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:31.641162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:31.641901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:31.642688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410db55-62bd-4d9e-a5f0-6715f48afc44 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:31.664506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:31.666854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:31.781901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 71/145] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:31.819896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:31.833845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410db55-62bd-4d9e-a5f0-6715f48afc44 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:31.875982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:31.876955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:31.877472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:31.878096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:31.892180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:31.897505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:31.898330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:31.899171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:31.901395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 75/146] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:31.907317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:31.962593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.027876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c16a6-55ba-41c6-ad3a-bfc1f5c94203 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.069426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.070054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.070334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.070608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.071290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:32.071590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.072989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.082108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 72/147] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:31 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:32.087712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.169277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.217881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caba215f-d0a5-43a8-af33-0face9d5aebb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.264069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.264730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.265260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.265538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] PATH_INFO: `/v3/users/f6ac0266f5814041a002e26688d7e667` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.267446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ac0266f5814041a002e26688d7e667)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.269748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170fcc79-26d1-472d-9413-63ffdeb72cb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.271841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 76/148] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/users/f6ac0266f5814041a002e26688d7e667 => generated 289 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:32.273060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db35c2-a482-4fdc-a684-7ca4682bd803 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.273382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db35c2-a482-4fdc-a684-7ca4682bd803 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.273654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96db35c2-a482-4fdc-a684-7ca4682bd803 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.275750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 77/149] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:32.280460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db35c2-a482-4fdc-a684-7ca4682bd803 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.290643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.294997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf31239f-58aa-4f64-84ad-f2dfe9bd324b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.315857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.338478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.339327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.339672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.340011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.357431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cc73c1db-6947-4275-a861-1d034a4e5d99 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:32.363494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:32.364369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:32.365141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 73/150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:32.366420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9b7b-97cc-49c7-aba3-d85fbacf4641 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.366420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9b7b-97cc-49c7-aba3-d85fbacf4641 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.368834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27d9b7b-97cc-49c7-aba3-d85fbacf4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.396770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d27d9b7b-97cc-49c7-aba3-d85fbacf4641 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:32.398097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d27d9b7b-97cc-49c7-aba3-d85fbacf4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:32.431466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96db35c2-a482-4fdc-a684-7ca4682bd803 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.503738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.506095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.506577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.507453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.509590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.514978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 74/151] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:32.516533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf878-adcc-453a-9365-5d5587c34110 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.517050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.518489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf878-adcc-453a-9365-5d5587c34110 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.520015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1edf878-adcc-453a-9365-5d5587c34110 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.521718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 78/152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:32.523982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.526299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 75/153] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:32.527269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf878-adcc-453a-9365-5d5587c34110 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.663187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.679156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdf2720-1854-4474-8171-b432710a2af0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.715686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.716630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.717105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.717604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.718528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:32.719059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.720617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b940e0da-4d82-4e62-bbf5-157ead9fd601 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.731389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 79/154] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:32.733339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc29f-5220-479a-8f62-296054154360 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.733826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc29f-5220-479a-8f62-296054154360 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.734295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560cc29f-5220-479a-8f62-296054154360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.737974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.756100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-560cc29f-5220-479a-8f62-296054154360 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:32.757648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-560cc29f-5220-479a-8f62-296054154360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:32.788478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1edf878-adcc-453a-9365-5d5587c34110 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.836291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 80/155] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:32.838012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cc29f-5220-479a-8f62-296054154360 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:32.886766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.887479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.887782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.888033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/users/f6ac0266f5814041a002e26688d7e667/roles/347a5a2f29bd4b8e9739e672d687a1a1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.889961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, user_id=f6ac0266f5814041a002e26688d7e667, role_id=347a5a2f29bd4b8e9739e672d687a1a1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.891406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.919016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 76/156] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:32 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/users/f6ac0266f5814041a002e26688d7e667/roles/347a5a2f29bd4b8e9739e672d687a1a1 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:32.930074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:32.953859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560cc29f-5220-479a-8f62-296054154360 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:32.989431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:32.990042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:32.990329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:32.990607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:32.991822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:32.993310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a2a7df-a002-481d-ab52-c9280cd4bfb0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:32.994902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 81/157] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:33.000959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.079564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81bc10-5a3d-42f0-8f7f-816d207dfa53 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.079914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81bc10-5a3d-42f0-8f7f-816d207dfa53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.080124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b81bc10-5a3d-42f0-8f7f-816d207dfa53 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.082312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 82/158] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:33.087911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.088190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.088463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.118162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:33.119379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:33.173064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb04aae7-34b9-4f35-945b-ba81f874f0c2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:33.244162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:33.245590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.245869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.246145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.261672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 83/159] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:33.285663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:33.295776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.383275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:33.384758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:33.444281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:33.489142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbab5c1-bb22-4bc4-b471-884e1625c852 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:33.558656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:33.560411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.560693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.560966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.580159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 77/160] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:33.583151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:33.588033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:33.589007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:33.589911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:33.590546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.590628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 84/161] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:33.590628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.677550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:33.712961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555d9dd5-1b95-42e7-bc76-cd9b2e57055a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:33.753440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:33.754085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.754364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.754622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.755784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:33.757257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:33.762443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 85/162] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:33 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:33.763301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.781547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:33.847781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be4a3dd-21a3-459d-946e-153145fe3d42 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:33.894592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155d1600-775c-4be0-9b9a-3b485b578a50 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:33.933705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:33.934465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.934753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.935031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:33.935708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:33.936014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:33.937629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:33.947303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 86/163] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:33.948413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:33.978449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:33.979105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:33.979376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:33.979641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.026094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:34.030962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:34.031842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:34.032628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 78/164] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 451 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:34.033338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.041604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:34.069665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33a5deb-d7fb-4642-b5d4-ff9e88919d57 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.132831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.133535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.133823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.134106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.134849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:34.135162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.136602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.149431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 87/165] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:33 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=08fff9389c4141b080d31ea8280129d0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:34.150263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.215578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c33824-d256-4e8c-8b6f-f446e9a60891 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.239855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:34.282647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.283363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.283692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.284523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.301911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:34.319085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:34.320059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:34.320871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 79/166] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:34.322317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.338995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec79f8-9788-4791-bc9e-95522b74c22c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.421676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:34.429169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.429859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.430148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.430434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] PATH_INFO: `/v3/users/cf343adbeb5a4274998fc6f26d67b66f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.434246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] RBAC: Authorizing `identity:get_user(user_id=cf343adbeb5a4274998fc6f26d67b66f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.435786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.437699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 88/167] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/users/cf343adbeb5a4274998fc6f26d67b66f => generated 247 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:34.440649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.564588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c524d145-978d-43aa-b79e-d607c17a71c0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.611075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.611276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58906f31-331a-45f4-bd41-8463cd5bf859 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.611697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.612664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.617211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.617211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:34.617211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.617211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.623875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 80/168] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:34.624949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.664026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:34.674039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.675338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.675616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.675884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.676563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:34.676864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.678260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.687102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 89/169] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:34.688053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.757759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d2565c5-4c03-4a57-ac4b-40ada4689064 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.796403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:34.809687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.810322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.810592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.810865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.859693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a5de6e-4b2a-4a67-bc98-307c47632c9b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:34.921906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:34.922553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:34.922835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:34.923113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:34.924964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.926382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.927980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 90/170] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:34.928737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:34.950095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:34.951622 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:34.998375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.095233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 81/171] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:35.096156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:35.111112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6850a23-ce57-4cbb-91d2-2c6ec9b14145 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.189699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.202362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d9692-8562-41f2-8653-34eed7801e61 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.207356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:35.208223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.208717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.209174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] PATH_INFO: `/v3/users/39a86a262916418689a8a39b9c57efca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.214480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] RBAC: Authorizing `identity:get_user(user_id=39a86a262916418689a8a39b9c57efca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:35.216140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f487fa-6be8-464b-bddd-5c193d6623a4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:35.218009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 91/172] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:34 2022] GET /identity/v3/users/39a86a262916418689a8a39b9c57efca => generated 275 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:35.224461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3989-9bda-44f8-927d-98ec8b02460e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.224961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3989-9bda-44f8-927d-98ec8b02460e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.225484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4d3989-9bda-44f8-927d-98ec8b02460e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.226955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 92/173] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:35.227953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3989-9bda-44f8-927d-98ec8b02460e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:35.234588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.246652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:35.247272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.247557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.247832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.336390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:35.337906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2bd195-bb38-4cea-aecb-da3ea6f2252b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:35.384211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4d3989-9bda-44f8-927d-98ec8b02460e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.430019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:35.431417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.432143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.432614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.434590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:35.436327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:35.439006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 93/174] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:35 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:35.440981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:35.450863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 82/175] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:35.456084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3133-f9c0-490c-b26e-c28777c33dd5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.456084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3133-f9c0-490c-b26e-c28777c33dd5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.456084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89f3133-f9c0-490c-b26e-c28777c33dd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.472934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d89f3133-f9c0-490c-b26e-c28777c33dd5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:35.474175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d89f3133-f9c0-490c-b26e-c28777c33dd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:35.500826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.528989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.552255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 83/176] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:35.558860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcaeea-263d-462d-8ecd-c5751e3b8fa8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.559245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcaeea-263d-462d-8ecd-c5751e3b8fa8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.559616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fcaeea-263d-462d-8ecd-c5751e3b8fa8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.565428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 84/177] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:35 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:35.566449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcaeea-263d-462d-8ecd-c5751e3b8fa8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:35.567698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6316f4c3-229f-4d0b-a08a-b8a84022d64e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.610351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:35.611204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.611651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.612229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.736481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:35.742761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91ed30d-c5f1-4421-a651-ceb094688bd1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:35.746481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fcaeea-263d-462d-8ecd-c5751e3b8fa8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.806923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:35.809647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.810137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.810666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.811718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=cf343adbeb5a4274998fc6f26d67b66f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:35.812987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:35.818427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:35.829097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 85/178] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:35 2022] GET /identity/v3/role_assignments?user.id=cf343adbeb5a4274998fc6f26d67b66f&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:35.831692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:35.880175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.926829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:35.962738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 94/179] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:35.969261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:35.969764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:35.970181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:35.984660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747c061-1c3e-4516-8e15-39bce8d27a98 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:35.994988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:35.996437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:36.027679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.028306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.028636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.028847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] PATH_INFO: `/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.030025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] RBAC: Authorizing `identity:get_project(project_id=d2479a484b0d42c09ab6cec9bf1e4305)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.031461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eb4cd6-d985-42b4-abc9-c637f9170432 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.033292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 86/180] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:35 2022] GET /identity/v3/projects/d2479a484b0d42c09ab6cec9bf1e4305 => generated 312 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.034782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51301-1f12-4cf1-a78d-336785436449 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.035063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51301-1f12-4cf1-a78d-336785436449 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.035408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f51301-1f12-4cf1-a78d-336785436449 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.036517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 87/181] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:36.037239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f51301-1f12-4cf1-a78d-336785436449 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.091133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 95/182] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:36.091771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.150327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.160471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f51301-1f12-4cf1-a78d-336785436449 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.196480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.197107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.197427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.197698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.207876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:36.211585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1e97687d-e63a-42a2-b41c-a4bfd249ecfe None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:36.212923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:36.213847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:36.214666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 88/183] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:36.215328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b339a-bde1-4a15-bd7d-28f564880d33 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.215328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b339a-bde1-4a15-bd7d-28f564880d33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.216105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38b339a-bde1-4a15-bd7d-28f564880d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.224075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905c83a7-8e1d-4c7d-9153-fa5c0b17a1bf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.238076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b38b339a-bde1-4a15-bd7d-28f564880d33 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:36.239245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b38b339a-bde1-4a15-bd7d-28f564880d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:36.262164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.263094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.263575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.264006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.265321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.266960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.268835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 96/184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.269868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.313058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 89/185] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:36.314564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba151d-81ca-4b56-b7f9-0b0c51c5f755 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.315502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba151d-81ca-4b56-b7f9-0b0c51c5f755 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.315906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba151d-81ca-4b56-b7f9-0b0c51c5f755 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.317427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 90/186] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:36.318253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba151d-81ca-4b56-b7f9-0b0c51c5f755 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.397012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50494cf-66d3-4304-9bb6-6d23e0f92bc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.408261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.429768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba151d-81ca-4b56-b7f9-0b0c51c5f755 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.432824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.433464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.433747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.434022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.434748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=d2479a484b0d42c09ab6cec9bf1e4305, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:36.435061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.436494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.442447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 97/187] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=d2479a484b0d42c09ab6cec9bf1e4305&role.id=08fff9389c4141b080d31ea8280129d0 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.446056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.470362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.471902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.472435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.472901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.474010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:36.474309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.475805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37742e5-c5b4-486e-b625-403053babaa5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.485315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 91/188] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.487988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.488293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.488575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.489656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.514243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:36.515580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:36.602847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89839b06-c767-40dc-897e-ae6b5b1c1c43 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.608188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 92/189] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:36.609302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.652802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.653955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.653955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.654150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.655283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=39a86a262916418689a8a39b9c57efca) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:36.656099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.657056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.664884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 98/190] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/role_assignments?user.id=39a86a262916418689a8a39b9c57efca&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 608 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.669285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.718273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.753492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b563db6-48f3-4709-8362-36ba6b97963f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.804192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.804762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.809297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.809297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.814136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:36.824833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:36.826579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f90ed84-af92-4f07-b067-4f1bc1d4f63f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:36.830099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:36.831629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:36.832430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:36.833033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 93/191] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:36.834711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.873118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.874149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.874615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.874924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:36.894020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:36.896167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:36.898820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 99/192] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:36.901315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:36.962994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aefb9120-d9a8-4e76-a899-add7f22c30b7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:36.997786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:36.998414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:36.998689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:36.998957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.000066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.001607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.004049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 94/193] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.006038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.009117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.014136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ea5c9-9619-4551-9ba9-075b239bd425 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.048840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.049606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.049884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.050152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.050811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:37.051111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.052476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.060505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 100/194] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.061247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.077634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.109321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6e0e0f-c1f8-48d1-8900-16c65deb612c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.143441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.144048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.144324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.144599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.160763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca203013-be80-4f65-9330-d6301d03c197 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.195695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.196319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.196598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.196870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.207264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:37.211513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:37.212452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:37.213374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:37.214168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:37.214777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.214850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 101/195] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:37.215141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.216015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.285366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.314367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 95/196] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.316031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.316755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bf1208-3050-4bbd-ab04-6d65397c54d4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.350314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.350952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.351235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.351513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.352166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.353703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.375148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 102/197] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:37 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:37.375148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.430344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb0d3f-a287-43bb-a99e-e0d798658b26 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.433061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.482729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.483395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.483925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.484205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.486167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.488454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.495705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 96/198] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.495879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d653cc-ee45-4509-a4ed-5cc98057facb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.495959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.520874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.532058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.532767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.533039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.534012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.535449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:37.535449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.536409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.544849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 103/199] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.545723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.619956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcf5d40-5f08-4b33-acdf-9f5d9b375910 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.671013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1250efab-b08f-4f1d-9222-99b2a9137ac0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.672036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.672677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.672955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.673493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.675218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.676827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.678829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 97/200] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.679546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.713588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.714222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.714479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.714777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.724809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.785888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.791037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87f3f3b-7d6b-48af-9adf-faa321a6907d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.797682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.799822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.826504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.827146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.827425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.827697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] PATH_INFO: `/v3/users/f6ac0266f5814041a002e26688d7e667` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.829036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] RBAC: Authorizing `identity:get_user(user_id=f6ac0266f5814041a002e26688d7e667)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.830554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:37.832534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 98/201] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/users/f6ac0266f5814041a002e26688d7e667 => generated 289 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:37.833328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.914335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 104/202] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:37.915241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:37.949171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde3f694-6b86-4487-8adc-047149a91be8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:37.961621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:37.993933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:37.994565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:37.994847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:37.995130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:37.995880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=358af929287341b194b2a5c271dbc05d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:37.996187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:37.998753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.006965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 99/203] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/role_assignments?user.id=358af929287341b194b2a5c271dbc05d&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:38.008026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:38.018948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:38.043291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc840cdd-b9b6-4945-a262-71956e601208 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:38.137885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:38.138815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:38.139273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:38.139715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:38.165707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e4d9f2-d0a9-4317-9c09-250b5dd65ca6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:38.207773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:38.208422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:38.208704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:38.208983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:38.210209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:38.211660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.213509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 100/204] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:38 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:38.219562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:38.223073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:38.224773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.272438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:38.320611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:38.332846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 105/205] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:38.338919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:38.432059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3f7be8-42f4-4e8d-aada-98e5ee1afdf7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:38.442478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790bcdd-5961-4aff-8e93-06165e3c0840 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:38.478615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:38.479617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:38.480110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:38.480748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:38.482136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:38.483845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.486020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 106/206] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:38 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:38.492148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:38.503582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:38.504384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:38.504494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:38.504716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:38.505482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=358af929287341b194b2a5c271dbc05d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:38.505790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:38.507495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-686ac62d-0168-42b7-bcf5-9979716db109 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.523149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 101/207] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:38 2022] GET /identity/v3/role_assignments?user.id=358af929287341b194b2a5c271dbc05d&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:38.558059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:38.604709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c790ba1-1ecf-40a1-840a-ccf07ffbaa06 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:38.647139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:38.648182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:38.648667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:38.649141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:38.650142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, scope.project.id=06d169324a4d476f89b7851d153f2121, user.id=f6ac0266f5814041a002e26688d7e667) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:38.650665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:38.652480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2000bf98-9ca7-4181-80b3-957edf93c8a7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:38.660441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 107/208] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:38 2022] GET /identity/v3/role_assignments?user.id=f6ac0266f5814041a002e26688d7e667&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:39.606053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a077b7-f5ca-40af-9ee7-5c3122a5136a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:39.606563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a077b7-f5ca-40af-9ee7-5c3122a5136a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:39.606563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a077b7-f5ca-40af-9ee7-5c3122a5136a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:39.608169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 102/209] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:39.614053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:39.614438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:39.614600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:39.633249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:39.634491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:39.678284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d51f-6625-4f48-ae0d-8b3286baf0b0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:39.678561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d51f-6625-4f48-ae0d-8b3286baf0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:39.678840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7d51f-6625-4f48-ae0d-8b3286baf0b0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:39.680173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 103/210] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:39.685650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:39.685926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:39.686197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:39.704685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:39.706523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:39.711401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 108/211] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:39.777316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 104/212] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:39.993787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.046695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.057355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.081672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.121316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e5b104-03a2-4697-b1eb-6a0e5215c4e2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.168816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.169873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.170157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.170432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.173561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d7557-88a6-4d52-a6a1-f6f2ab50f492 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.184371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:40.191855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:40.192957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:40.193779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:40.196393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 109/213] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:40.205581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.225888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.227230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.227926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.228370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.230306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:40.232499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54abdf47-eefd-4aea-9958-55f930f513fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:40.240530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 105/214] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:40.240530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b1c1d-43c5-4943-808c-b67971335554 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.240530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b1c1d-43c5-4943-808c-b67971335554 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.240530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51b1c1d-43c5-4943-808c-b67971335554 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.244413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 106/215] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:40.245362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b1c1d-43c5-4943-808c-b67971335554 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.318672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc29e00-6bb9-43f3-8b1d-c05cb22d01ab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.333979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.354410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.357716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.358012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51b1c1d-43c5-4943-808c-b67971335554 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.358391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.358704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.359117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.359833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:40.360821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:40.362079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741df108-6f78-4d3c-8935-57952c44f846 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:40.370615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 110/216] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:40.375422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.375739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.376240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.394766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:40.395746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.395955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:40.396354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.396631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.396901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.397579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:40.399986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:40.427752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 107/217] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:40 2022] POST /identity/v3/users => generated 297 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:40.428885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.480816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 111/218] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:40.564232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ad688e-0b3e-46fc-8ec7-14096e3a3ebf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.606653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.607394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.607621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.607896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] PATH_INFO: `/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.622805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] RBAC: Authorizing `identity:get_user(user_id=8d0f86e113e844e08cb9e1e7abf1ce7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:40.624233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b61e3-4708-4092-8c95-dc3b6a45f351 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:40.626076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 108/219] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:40 2022] GET /identity/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:40.631825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.714955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d73d9-cc34-48b2-8f9b-51beb7aa7631 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.715235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d73d9-cc34-48b2-8f9b-51beb7aa7631 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.715675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9d73d9-cc34-48b2-8f9b-51beb7aa7631 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.721233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 109/220] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:56:40.722713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.723137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.723546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.760289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:40.762152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:40.777376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.779585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b5a96b-ac68-4de8-ad04-db8ad1a72227 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:40.788335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:40.842888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:40.843520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:40.843804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:40.845161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:40.897792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 110/221] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:40.899660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:40.946260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:40.949074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.082942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090ff138-92eb-4b08-8ad8-5201b2719fc9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.127945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.128990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.129556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.130014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.141145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:41.147116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:41.148017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:41.148797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:41.151052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 111/222] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:41.160944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 112/223] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:41.162155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.170287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.171056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.174531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.316556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a271d15-d955-4bf6-babe-ae5a10dac8c9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.325996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd1358f-6d2e-4fc2-ba03-9454a97316ca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.352952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.353515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.353961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.354405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.355216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:41.355663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.357206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.366085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 112/224] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:41.367093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.372550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.373468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.373949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.374416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.375784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.378127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.379975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 113/225] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:41.380932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.441566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.460295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.480886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb6a39-0e1f-485c-aa71-a1a1297d4127 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.492177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a307e33-312b-4e16-abc0-2abc36dce76e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.517216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.518373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.518868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.519280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.528392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.529025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.529334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.529612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.530735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.531506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:41.532481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.535279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 114/226] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:41.536199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:41.538087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:41.539110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:41.540023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:41.546834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 113/227] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:41.547914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.649162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc18799-2090-4e96-9601-12b33f9ea72a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.667431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04aa9c91-12ae-4be2-abd3-8c09e87c77ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.681394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.692213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.692851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.693624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.694859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.696020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.698001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.701392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 114/228] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:41.702370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.715245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.716162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.716769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.717274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.718217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=8d0f86e113e844e08cb9e1e7abf1ce7f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:41.718859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.720714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.733402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 115/229] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/role_assignments?user.id=8d0f86e113e844e08cb9e1e7abf1ce7f&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=08fff9389c4141b080d31ea8280129d0 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:41.734883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.742707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:41.828895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17a529-9352-4fdb-a5f4-5cfa18c77da1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.869944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:41.870706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:41.870985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:41.871257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:41.871937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:41.872237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:41.873854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:41.884993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 115/230] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:41.891104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:41.965411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897906f-372b-4b46-a9a7-d8490091b5db None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:41.985484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:42.012676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:42.013730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.014235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.014706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/users/358af929287341b194b2a5c271dbc05d/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:42.023606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, user_id=358af929287341b194b2a5c271dbc05d, role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:42.025485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:42.052139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 116/231] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:41 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/users/358af929287341b194b2a5c271dbc05d/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:42.066067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f6b86e-3da0-4f19-ae6b-ac7da7dd2e76 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:42.117674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:42.118785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.119267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.119779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:42.121851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:42.123645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:42.129332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 116/232] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:41 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:42.131231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:42.220990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:42.270749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f07f8e-4f1f-4bb1-bd86-458438eb18dc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:42.311129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:42.311763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.312044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.312320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:42.313490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:42.315777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9efc17-473b-4ee1-9bda-ea16389e8775 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:42.317482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 117/233] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:42 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:42.323306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:42.431433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ff41c4-7580-492d-90c2-eb7ed605827b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:42.455701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:42.467105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:42.467767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.468047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.468320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/users/358af929287341b194b2a5c271dbc05d/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:42.470247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, user_id=358af929287341b194b2a5c271dbc05d, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:42.472675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ad3407-6d20-40e1-a5f7-13afeab84316 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:42.488460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 117/234] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:42 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/users/358af929287341b194b2a5c271dbc05d/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:42.991187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf671-f925-4e77-99de-a8b1f61a1575 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.991729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf671-f925-4e77-99de-a8b1f61a1575 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.991729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1bf671-f925-4e77-99de-a8b1f61a1575 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:42.993401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 118/235] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:42.998660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:42.999073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:42.999261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.026198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:43.027394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:43.032233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cf5e-d690-4a7d-a4c2-6dc838181067 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:43.032520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cf5e-d690-4a7d-a4c2-6dc838181067 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:43.033377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b468cf5e-d690-4a7d-a4c2-6dc838181067 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.035041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 119/236] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:43.051439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:43.051734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:43.051987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.090596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:43.091807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:43.134576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 118/237] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:43.191953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 120/238] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:43.478468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:43.538426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:43.643928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:43.645381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2def60a8-139a-4c4a-ac80-13395ab82793 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:43.669546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:43.708190 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:43.708824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:43.709101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:43.709392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.719208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdb2a57-702a-4071-be35-658db0ab2db0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:43.731493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:43.736446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:43.737566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:43.738542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:43.739807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 119/239] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:43.745517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:43.785367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:43.785998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:43.786288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:43.786542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.787654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:43.789087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:43.797444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 121/240] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:43.799237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:43.875594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57bfc49-fc30-4099-97bb-a5d93f68262b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:43.911157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:43.911769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:43.912045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:43.912377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:43.913042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:43.917244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:43.917244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:43.923324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 120/241] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:43.929222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:43.966374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:43.998051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0369711-e11d-4a0d-b93e-fe0e8ee38126 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.034401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a87ae81-b0f6-4e0c-b602-31dabcd9d6c7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.038292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:44.050860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.052075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.052988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.053763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.054607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:44.056808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6182f75b-2ff3-4bca-808f-f676871e05e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:44.073434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.074227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.074514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.074775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] PATH_INFO: `/v3/users/eed9a07c478a4ae5891531b31a20c818` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.087711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 122/242] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:43 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:56:44.089468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd94d6-f27b-4e02-98c5-d21c690542ec None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.090026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd94d6-f27b-4e02-98c5-d21c690542ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.090520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdd94d6-f27b-4e02-98c5-d21c690542ec None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.092075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 123/243] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:44.100596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.101480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.101959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.109077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] RBAC: Authorizing `identity:get_user(user_id=eed9a07c478a4ae5891531b31a20c818)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:44.110703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:44.112820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 121/244] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:43 2022] GET /identity/v3/users/eed9a07c478a4ae5891531b31a20c818 => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:44.118309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:44.124442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:44.127867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:44.214081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 124/245] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:44.312585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:44.323977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aee89c1-62e5-4968-ac33-4e3115545308 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.363351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.363969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.364246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.364516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.444672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:44.446179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:44.538369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:44.553592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:44.559049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 122/246] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:44.565918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:44.653112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be950f5-b8a0-47c9-a55f-801309867a10 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.670445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:44.682374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98978fdf-745d-4dcd-ad85-878c1e1842ab None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.695821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.696687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.697574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.697861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.714148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-74d676b1-31e5-455c-bcae-046aee360566 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:44.719158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:44.720058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:44.721701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 125/247] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:44.722510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43068a2-5c74-420d-b4b8-a3f9d655fe39 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.722753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43068a2-5c74-420d-b4b8-a3f9d655fe39 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.723029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43068a2-5c74-420d-b4b8-a3f9d655fe39 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.725335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 126/248] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:44.731561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43068a2-5c74-420d-b4b8-a3f9d655fe39 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:44.732984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.733848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.734302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.734813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.737032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:44.738791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb560f-b238-4640-9693-768bb27259ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:44.740463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 123/249] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:44.740463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.740463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.740463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.763020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:44.764492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:44.839589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:44.854887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 124/250] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:44.855171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:44.880897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43068a2-5c74-420d-b4b8-a3f9d655fe39 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:44.958167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:44.959767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.960964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.961480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.963638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:44.964147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:44.965831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3b90b-40ed-4621-b1e7-bde53d9494c9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:44.977141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 127/251] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:44.982346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b2b3-0825-49eb-8e02-a395f1827967 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:44.982837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b2b3-0825-49eb-8e02-a395f1827967 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:44.983285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d5b2b3-0825-49eb-8e02-a395f1827967 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:44.985963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 128/252] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:44.989727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b2b3-0825-49eb-8e02-a395f1827967 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.027691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621f17ed-76d1-491e-8a2f-b7556314d1e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.062461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:45.098676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.099177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.099450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.099722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.100461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=eed9a07c478a4ae5891531b31a20c818) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:45.100770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:45.102258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3519f2f7-10df-4f79-9bd1-cdd9761e9d16 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:45.111345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 125/253] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/role_assignments?user.id=eed9a07c478a4ae5891531b31a20c818&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:45.112415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.112702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.112978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.151328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:45.152556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:45.184420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d5b2b3-0825-49eb-8e02-a395f1827967 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.255569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.256225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.256504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.258203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:45.260759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] PATH_INFO: `/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.262831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] RBAC: Authorizing `identity:get_user(user_id=8d0f86e113e844e08cb9e1e7abf1ce7f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:45.266681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:45.271845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 129/254] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:44 2022] GET /identity/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f => generated 297 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:45.272708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.298860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 126/255] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:45.301007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.463374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c246dc2-30e6-418a-a6f2-676d6458e230 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.498287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.498926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.499204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.499474 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.500610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:45.502782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:45.504740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 127/256] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:45 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:45.510708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.513614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5811b36-d261-4449-9785-0a06363843a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.529610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:45.597547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:45.609133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de153de-5843-4130-add1-0c9553731602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.609795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de153de-5843-4130-add1-0c9553731602 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.610071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de153de-5843-4130-add1-0c9553731602 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.610343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de153de-5843-4130-add1-0c9553731602 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.641846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de153de-5843-4130-add1-0c9553731602 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1de153de-5843-4130-add1-0c9553731602 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:45.647875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:45.648756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:45.650551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 130/257] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:45.658722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de153de-5843-4130-add1-0c9553731602 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.672901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26e2346-4b95-4137-9c24-79521749714a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.766177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.766779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.767605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.767895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/users/8d0f86e113e844e08cb9e1e7abf1ce7f/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.773934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, user_id=8d0f86e113e844e08cb9e1e7abf1ce7f, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:45.775423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:45.802394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 128/258] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:45 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/users/8d0f86e113e844e08cb9e1e7abf1ce7f/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 04:56:45.802987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:45.848404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de153de-5843-4130-add1-0c9553731602 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:45.918964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:45.919650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:45.919925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:45.920194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:45.920926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:45.921253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:45.922651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:45.933153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 131/259] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:45.940603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.002113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.075440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b411f5-854d-42f5-bba1-ff20685226f9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.095646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3aa558-bd3e-4109-81cd-60db6b7f5302 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.101971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.128538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.129352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.129632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.129901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.151545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:46.157007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:46.158640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:46.159459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 129/260] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:56:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 356 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:46.169879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.170834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.171466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.171739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.172010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.174162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:46.175602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:46.177336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 132/261] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:45 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:46.199038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.314426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0f3c9f-296c-4984-b484-0607958633c2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.355263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.355792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.356064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.356332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.357003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:46.358777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:46.360175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:46.376151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 130/262] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:46.382084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.382464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.393097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddcedf2-17d4-4f7f-9944-8fdf3bc6beca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.452300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.459133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.459747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.461276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.461554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.543820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d825bab-450b-46d6-a7d5-c8004f7c8f9c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.589868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.590524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.590805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.591079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] PATH_INFO: `/v3/users/358af929287341b194b2a5c271dbc05d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.592517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] RBAC: Authorizing `identity:get_user(user_id=358af929287341b194b2a5c271dbc05d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:46.594026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:46.596406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 131/263] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:46 2022] GET /identity/v3/users/358af929287341b194b2a5c271dbc05d => generated 283 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:46.602283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.621813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:46.623289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:46.731319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596a042-f73a-450f-8a8c-000bbd9f52d0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:46.734167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.772604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:46.773233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:46.773518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:46.776107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:46.831778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 133/264] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 633 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:46.832433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:46.838737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:46.918039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:46.919416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:47.071663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836006e3-319f-4683-bc72-3729c04ef40f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:47.138795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:47.140190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.140604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.141037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.142930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:47.144507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:47.150381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 134/265] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:46 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:47.151040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 132/266] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 549 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:47.157001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:47.158518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:47.164879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:47.289031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:47.349444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1c0831-90e7-4175-a81e-69586bf587b7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:47.367174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8eaed2-913d-4719-b158-560643616866 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:47.400828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:47.401775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.402483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.402904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.404429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:47.406588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:47.408776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 135/267] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:47 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:47.420116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:47.470460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:47.471087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.471362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.471631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.472361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=358af929287341b194b2a5c271dbc05d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:47.472666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:47.474127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa3062a3-f938-4647-b30a-6953a32a0d19 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:47.490641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 133/268] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:47 2022] GET /identity/v3/role_assignments?user.id=358af929287341b194b2a5c271dbc05d&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 608 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:47.491721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839007-dc18-4308-80a4-259e22a70080 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.492006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839007-dc18-4308-80a4-259e22a70080 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.492280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b839007-dc18-4308-80a4-259e22a70080 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.493754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 134/269] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:47.494861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ec52-0380-4869-84da-fa1a214ed6a7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.495198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ec52-0380-4869-84da-fa1a214ed6a7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.495469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a38ec52-0380-4869-84da-fa1a214ed6a7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.496756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 135/270] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:47 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:47.499556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb0f3-fca2-47cd-ae75-fa346aa2c0b7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.500793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb0f3-fca2-47cd-ae75-fa346aa2c0b7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.502030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30fb0f3-fca2-47cd-ae75-fa346aa2c0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.534383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a30fb0f3-fca2-47cd-ae75-fa346aa2c0b7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:47.535957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a30fb0f3-fca2-47cd-ae75-fa346aa2c0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:47.607070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:47.615485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 136/271] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:47.620969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9477fb-cf93-4c1e-9a37-9181af01f231 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.621621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9477fb-cf93-4c1e-9a37-9181af01f231 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.622846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9477fb-cf93-4c1e-9a37-9181af01f231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.628083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201355-33af-43fb-99ed-edbad4acf2e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:47.660674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1e9477fb-cf93-4c1e-9a37-9181af01f231 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:47.662233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e9477fb-cf93-4c1e-9a37-9181af01f231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:47.694886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:47.701486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:47.702350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.702650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.702958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.705134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=358af929287341b194b2a5c271dbc05d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:47.705539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:47.707001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e83025-4134-47e6-9831-01f15417cbf5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:47.715130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 136/272] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:47 2022] GET /identity/v3/role_assignments?user.id=358af929287341b194b2a5c271dbc05d&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:47.773574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 137/273] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:47.953860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c50f6-68c0-4cc4-bb5a-e685d2b60b29 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.954861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c50f6-68c0-4cc4-bb5a-e685d2b60b29 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.955237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c50f6-68c0-4cc4-bb5a-e685d2b60b29 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.957000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 137/274] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:47.962178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:47.962642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:47.963108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:47.984706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c50f6-68c0-4cc4-bb5a-e685d2b60b29 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:47.990137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:47.991343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:48.087967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 138/275] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:48.127668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.137298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c50f6-68c0-4cc4-bb5a-e685d2b60b29 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.174692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.175345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.175597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.175872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.186678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:48.192928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:48.193882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:48.194782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 138/276] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:48.199935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.207906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.260872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ea7fef-c68d-47b5-a781-6a10a9080e46 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.264706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.301415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.302506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.302989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.303461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.304878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.306662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.308773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 139/277] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:48.314465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54a4fba-3e99-41c2-af6e-591db0190613 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.315230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.352576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.353673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.354099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.354515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.355355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:48.355891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.357520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.367547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 139/278] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:48.372874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.432745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4322ec45-a51d-41bf-a851-4d433e415d7f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.458074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.469009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.469636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.469966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.470368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.471016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.472463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de933158-7f0d-4f54-aef8-bbd84fa83645 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.479460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c0451-ffb2-408f-8b36-7a016551d500 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 140/279] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:56:48 2022] POST /identity/v3/users => generated 293 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853db-8f45-49c3-b8b5-ad992862cf75 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853db-8f45-49c3-b8b5-ad992862cf75 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef853db-8f45-49c3-b8b5-ad992862cf75 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 141/280] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:48 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:48.505932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef853db-8f45-49c3-b8b5-ad992862cf75 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.512820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.535137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.536416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.536757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.537330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] PATH_INFO: `/v3/users/474b1d3988d84a449bf1803d0abe24ca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.554500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] RBAC: Authorizing `identity:get_user(user_id=474b1d3988d84a449bf1803d0abe24ca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.556142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17134b00-74da-4c76-8691-9d855eb0655f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.558190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 140/281] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/users/474b1d3988d84a449bf1803d0abe24ca => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:48.564474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.564751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.565019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.584452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:48.585715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:48.620133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef853db-8f45-49c3-b8b5-ad992862cf75 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.661878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.663170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.663170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.663170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.664655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 141/282] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:48.665730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.677550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:48.682916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:48.683851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:48.684659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 142/283] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:48.691050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.744077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.807172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd64c85-367c-4291-abbe-26c5e4ac8dc6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.814022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf61ffe-9d7e-4650-b908-ecca4753b022 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:48.819267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:48.851361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.851973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.852252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.852523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.853288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, user.id=474b1d3988d84a449bf1803d0abe24ca, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:48.853597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.855035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.857845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:48.858759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:48.859245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:48.859707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:48.860252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 142/284] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/role_assignments?user.id=474b1d3988d84a449bf1803d0abe24ca&scope.system=all&role.id=08fff9389c4141b080d31ea8280129d0 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:48.860845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:48.861430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:48.863029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:48.873909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 143/285] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:48.879961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:48.968122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.014871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e2bbc2-bbda-4859-b65e-ce82637ecd93 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.057543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.058830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.059314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.060371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] PATH_INFO: `/v3/users/eed9a07c478a4ae5891531b31a20c818` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.062148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] RBAC: Authorizing `identity:get_user(user_id=eed9a07c478a4ae5891531b31a20c818)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.065877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.068134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 143/286] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/users/eed9a07c478a4ae5891531b31a20c818 => generated 297 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:49.074405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.098226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da3da4a-7bcb-42b0-8eff-9c97c3be7314 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.104151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.155649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.162509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.163172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.163460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.163737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.184430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:49.190159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:49.191040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:49.191843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 144/287] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:49.198114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.252446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3e8a6e-5ba2-4859-8ea6-70b5e8b917f3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.332036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.332597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.332880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.333157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.334353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.335788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.338837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 144/288] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:49 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:49.342983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.358411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dfd701-c52f-4917-a121-8fa8de66bdcf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.402823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.403460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.403743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.404054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.404701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:49.405002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.406935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.425745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 145/289] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:49.432612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.463918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.520149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67f5fbb-cf24-44f2-a30a-69974bf71376 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.531214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.548948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0250ccd7-4fbc-4d28-9594-613aa5ad48ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.592547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.593130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.593437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.593712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/users/eed9a07c478a4ae5891531b31a20c818/roles/347a5a2f29bd4b8e9739e672d687a1a1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.597271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, user_id=eed9a07c478a4ae5891531b31a20c818, role_id=347a5a2f29bd4b8e9739e672d687a1a1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.598732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.613442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.614082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.614365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.614645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] PATH_INFO: `/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.615800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] RBAC: Authorizing `identity:get_user(user_id=8d0f86e113e844e08cb9e1e7abf1ce7f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.617311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.622637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 146/290] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:49 2022] GET /identity/v3/users/8d0f86e113e844e08cb9e1e7abf1ce7f => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:49.625838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 145/291] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:56:49 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/users/eed9a07c478a4ae5891531b31a20c818/roles/347a5a2f29bd4b8e9739e672d687a1a1 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:49.629613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:49.737221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.744497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629d596-eb09-4209-88d7-a92d34ae3ac8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:49.784814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:49.785500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:49.785927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:49.786207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:49.859844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:49.862281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:49.963210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:49.972085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 147/292] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:49.982275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:50.109339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672497e9-b10f-456c-a1d6-f16cc0f5070d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:50.158115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:50.159102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:50.159575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:50.160042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:50.161415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:50.163061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5b00b3-8cfd-49b1-981d-4fb95a542f57 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:50.164888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 146/293] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:49 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:50.171147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:50.317588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ad9089-f437-41bd-864f-c9ee8b8202e8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:50.360876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:50.361672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:50.361855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:50.362137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:50.362872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=8d0f86e113e844e08cb9e1e7abf1ce7f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:50.363184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:50.364623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6089e913-fc56-4e3b-9d9d-1d68d397aa3f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:50.371064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 148/294] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:50 2022] GET /identity/v3/role_assignments?user.id=8d0f86e113e844e08cb9e1e7abf1ce7f&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=08fff9389c4141b080d31ea8280129d0 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:50.821610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b27f-021b-4e81-ad83-04aed54f2037 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:50.822499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b27f-021b-4e81-ad83-04aed54f2037 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:50.822777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb40b27f-021b-4e81-ad83-04aed54f2037 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:50.824242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 147/295] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:50.829821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938766c-f3c4-489a-a6c3-606d979dcf2e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:50.830105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938766c-f3c4-489a-a6c3-606d979dcf2e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:50.830380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3938766c-f3c4-489a-a6c3-606d979dcf2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:50.851906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3938766c-f3c4-489a-a6c3-606d979dcf2e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:50.853482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3938766c-f3c4-489a-a6c3-606d979dcf2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:50.919794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:50.948082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 149/296] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:51.180166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2975c-a503-4acd-b900-af0c58c015de None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.180654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2975c-a503-4acd-b900-af0c58c015de None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.181038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca2975c-a503-4acd-b900-af0c58c015de None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.182632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 148/297] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:51.187837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e9ec-a2d7-4362-bc39-22dc96cac5b6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.188748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e9ec-a2d7-4362-bc39-22dc96cac5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.189306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1860e9ec-a2d7-4362-bc39-22dc96cac5b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.212453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1860e9ec-a2d7-4362-bc39-22dc96cac5b6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:51.213662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1860e9ec-a2d7-4362-bc39-22dc96cac5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:51.234794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2975c-a503-4acd-b900-af0c58c015de None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.274632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:51.293241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 150/298] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:51.294748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b5ad-639a-4344-a7a5-9da952645753 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.295035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b5ad-639a-4344-a7a5-9da952645753 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.295307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6956b5ad-639a-4344-a7a5-9da952645753 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.296531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 151/299] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:51.310760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.311049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.311328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.332991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:51.334204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:51.368001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca2975c-a503-4acd-b900-af0c58c015de None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.411375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.412404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.412909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.413338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.421336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 152/300] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:51.429661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:51.434603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:51.435462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:51.436265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 149/301] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:51.441575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.492094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:51.544121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda55f65-fa52-4bbc-9129-70e843c9f1be None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.574770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.581840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.582458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.582736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.583007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.583676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:51.583987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:51.585641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:51.596375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 153/302] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:51.609281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.695738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:51.704944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce3db35-dbea-4c97-8057-8ba48d70ea74 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.732825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bdee2f-8bdd-48eb-820e-503ac0d9a916 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.739804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.740657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.740939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.741228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.744152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:51.753526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:51.760237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:51.761293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:51.762099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:51.762791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 150/303] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:51.763306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.772123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.772757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.773036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.773340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] PATH_INFO: `/v3/users/fd894de184ea427b95d341a813d6b5bc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.787110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] RBAC: Authorizing `identity:get_user(user_id=fd894de184ea427b95d341a813d6b5bc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:51.788574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:51.790255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 154/304] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/users/fd894de184ea427b95d341a813d6b5bc => generated 293 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:51.794350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.880923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9ddfd0-0006-4628-b27e-b4dbe31c45aa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.896985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e113d0e2-6eb6-44a3-bc9b-fa57cb75c0f9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:51.915678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.916564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.917038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.917514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.918835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:51.920429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:51.922198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 151/305] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:51.923738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.943128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:51.944298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:51.944745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:51.945256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:51.946586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:51.947075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:51.948629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:51.952255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:51.958247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 155/306] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:51.958247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:51.989914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:52.041171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c9646e1-c7a6-4541-b0cb-46e74e35be5c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.063851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649e0729-8af9-4d0f-a7c1-675f3caa4d7e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.075580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.076327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.076701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.077352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.078082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, user.id=fd894de184ea427b95d341a813d6b5bc, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:52.078411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:52.079972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:52.084773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 152/307] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 04:56:51 2022] GET /identity/v3/role_assignments?user.id=fd894de184ea427b95d341a813d6b5bc&scope.system=all&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:52.084773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:52.097142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.097798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.098078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.098348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] PATH_INFO: `/v3/groups` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.098994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:52.100502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c05d5a-d71f-41b1-af94-51016e5c2bbe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:52.121593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 156/308] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Sep 1 04:56:51 2022] POST /identity/v3/groups => generated 229 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:56:52.127098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0135b-a476-44ab-b32f-9a44d1000b93 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.127386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0135b-a476-44ab-b32f-9a44d1000b93 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.127660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d0135b-a476-44ab-b32f-9a44d1000b93 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.133914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 157/309] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:52.135720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.136262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.136728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.158390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:52.159762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:52.213959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:52.232475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4da90c2-a666-4377-9bb1-639e48509d12 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.253831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 158/310] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:52.273489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.274140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.274417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.274690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] PATH_INFO: `/v3/users/474b1d3988d84a449bf1803d0abe24ca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.275911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] RBAC: Authorizing `identity:get_user(user_id=474b1d3988d84a449bf1803d0abe24ca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:52.277443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:52.279400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 153/311] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:52 2022] GET /identity/v3/users/474b1d3988d84a449bf1803d0abe24ca => generated 293 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:52.285351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:52.309094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:52.397251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b9f9fa-32c6-4b69-a9ee-4ce4f5f06357 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.432529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.433288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.433471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.433742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] PATH_INFO: `/v3/system/users/474b1d3988d84a449bf1803d0abe24ca/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.435141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=474b1d3988d84a449bf1803d0abe24ca, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:52.436511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:52.446845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 159/312] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Sep 1 04:56:52 2022] PUT /identity/v3/system/users/474b1d3988d84a449bf1803d0abe24ca/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:52.539246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:52.649490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374503d5-895f-4f3e-ad31-9abe69db8c04 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.685124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.685797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.686072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.686342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.697345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:52.702242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:52.703107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:52.704496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:52.708726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 154/313] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:52 2022] GET /identity/v3/roles/reader => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:52.710135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:52.800446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:52.818578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a0b994-095a-4701-9005-d3326bfd843f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:52.854529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:52.855148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:52.855430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:52.855706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:52.856380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:52.856685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:52.858077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:52.866758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 160/314] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:52.872126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:52.894553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:52.982788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4189ba-4959-45f9-823b-0ef9967d9176 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:53.018717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:53.019344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:53.019616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:53.019883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] PATH_INFO: `/v3/users/eed9a07c478a4ae5891531b31a20c818` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:53.021007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] RBAC: Authorizing `identity:get_user(user_id=eed9a07c478a4ae5891531b31a20c818)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:53.022506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:53.028151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 155/315] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:52 2022] GET /identity/v3/users/eed9a07c478a4ae5891531b31a20c818 => generated 297 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:53.030218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:53.140737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b11e3-c4d8-46be-bfa5-4f4728758a58 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:53.175988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:53.176604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:53.176884 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:53.177161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:53.192791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.249877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:53.252038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:53.373288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 161/316] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 04:56:53.378964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:53.461229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.479912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbdd4a5-9268-43a7-a29d-c478532677cf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:53.514551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:53.515179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:53.515453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:53.515727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:53.516975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:53.518565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464339da-351e-4505-b9ec-a0933eb2aa3e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:53.525118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 156/317] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:53 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:53.526587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:53.578417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:53.634566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb18138-f495-46c9-b2e7-b3827b93b11c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:53.688782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:53.689742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:53.690206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:53.690657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:53.691604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, scope.project.id=b67deb8428b64047a75051b543584c74, user.id=eed9a07c478a4ae5891531b31a20c818) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:53.692106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:53.693753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e373f794-2a0c-4ceb-9554-11f0d2469d8d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:53.700538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 162/318] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:56:53 2022] GET /identity/v3/role_assignments?user.id=eed9a07c478a4ae5891531b31a20c818&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:54.153020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c827d5-2a34-4b29-a105-2366a0b7762d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.153563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c827d5-2a34-4b29-a105-2366a0b7762d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.153637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c827d5-2a34-4b29-a105-2366a0b7762d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.154976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 157/319] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:54.160225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.160521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.160799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.179447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:54.180633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:54.205949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25360f0f-3b9c-42ca-bda4-ee23cb48ccb4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.206196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25360f0f-3b9c-42ca-bda4-ee23cb48ccb4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.206514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25360f0f-3b9c-42ca-bda4-ee23cb48ccb4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.207931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 158/320] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:54.213079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0a3f-d552-43e8-98ce-df6ab81c5b36 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.213401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0a3f-d552-43e8-98ce-df6ab81c5b36 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.213683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca0a3f-d552-43e8-98ce-df6ab81c5b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.232520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58ca0a3f-d552-43e8-98ce-df6ab81c5b36 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:54.233738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58ca0a3f-d552-43e8-98ce-df6ab81c5b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:54.251874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 163/321] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:54.306016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 159/322] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:54.524700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.541340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68bfd-2519-4544-887e-34a04d571488 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.541623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68bfd-2519-4544-887e-34a04d571488 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.541889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a68bfd-2519-4544-887e-34a04d571488 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.543374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 160/323] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:54.548687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.548997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.549302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.568425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:54.571406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:54.572775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:54.627075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a471a352-9cfa-4b94-a5e8-6eed8e76d6e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:54.639744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 161/324] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:54.640587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.652776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:54.662375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:54.663010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.663307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.663558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.674615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:54.679435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:54.680540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:54.681513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 164/325] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:54.686443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.752945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b587b3e-fb2d-465c-89e2-a8d6c1873bf5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:54.787047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:54.790429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:54.791055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.791327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.791431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d00c624-ea33-4dee-b3ce-d804196a3233 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:54.791594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.792704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:54.794153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:54.795708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 162/326] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:56:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:54.801701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.829153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:54.829996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.830445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.830977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.831897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:54.832354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:54.833759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:54.842358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 165/327] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:54.848248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.882033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:54.905872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4a9bb-99a5-4f4d-8a0b-4b9f246aa259 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:54.943213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:54.943824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.944097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.944369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] PATH_INFO: `/v3/groups` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.944997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:54.946469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:54.954657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d405e6e1-7b0a-41d3-9492-b0c4a112085d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:54.961710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 163/328] 10.222.0.43 () {60 vars in 1134 bytes} [Thu Sep 1 04:56:54 2022] POST /identity/v3/groups => generated 226 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:56:54.962628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:54.995828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:54.996496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:54.996871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:54.997043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] PATH_INFO: `/v3/users/fd894de184ea427b95d341a813d6b5bc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:54.998297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] RBAC: Authorizing `identity:get_user(user_id=fd894de184ea427b95d341a813d6b5bc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:54.999819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:55.007080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 166/329] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:54 2022] GET /identity/v3/users/fd894de184ea427b95d341a813d6b5bc => generated 293 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:55.008242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:55.045288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:55.087260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f995730c-647b-475c-8305-1ec984704f74 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:55.121689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04343389-15f0-4f58-a3ef-33cc4053dcdb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:55.129486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:55.130581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:55.130581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:55.131020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:55.141109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:55.146930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:55.152416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:55.153945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:55.154749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 164/330] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:55.159761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:55.164960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:55.165744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:55.166024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:55.166298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] PATH_INFO: `/v3/system/users/fd894de184ea427b95d341a813d6b5bc/roles/347a5a2f29bd4b8e9739e672d687a1a1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:55.167769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fd894de184ea427b95d341a813d6b5bc, role_id=347a5a2f29bd4b8e9739e672d687a1a1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:55.169158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:55.179307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 167/331] 10.222.0.43 () {58 vars in 1334 bytes} [Thu Sep 1 04:56:55 2022] PUT /identity/v3/system/users/fd894de184ea427b95d341a813d6b5bc/roles/347a5a2f29bd4b8e9739e672d687a1a1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:56:55.284892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfad2fb1-7ad9-48fd-8151-8649b186c5e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:55.326182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:55.326788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:55.327065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:55.327340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:55.328083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:55.328317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:55.330459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:55.339617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 165/332] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:55.345886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:55.447488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:55.456295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f0d4e-14f3-4e39-9a1b-403f70ecf850 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:55.497341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:55.497989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:55.498270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:55.498539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] PATH_INFO: `/v3/users/474b1d3988d84a449bf1803d0abe24ca` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:55.499697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] RBAC: Authorizing `identity:get_user(user_id=474b1d3988d84a449bf1803d0abe24ca)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:55.501492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359c3957-0c47-48d8-a84f-30ce689177ea None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:55.503429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 168/333] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:55 2022] GET /identity/v3/users/474b1d3988d84a449bf1803d0abe24ca => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:56:55.509693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:55.583500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:55.635627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a978e471-724a-4cb8-bffd-e007616bbc68 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:55.676005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:55.676617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:55.676892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:55.677171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:55.677919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] RBAC: Adding query filter params (role.id=08fff9389c4141b080d31ea8280129d0, user.id=474b1d3988d84a449bf1803d0abe24ca, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:55.678228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:55.679668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59429b5c-39ba-4652-a50a-65ad1419334a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:55.697209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 166/334] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 04:56:55 2022] GET /identity/v3/role_assignments?user.id=474b1d3988d84a449bf1803d0abe24ca&scope.system=all&role.id=08fff9389c4141b080d31ea8280129d0 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:57.130870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28e28-de5f-4e92-8f23-44b3af537eec None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.131842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28e28-de5f-4e92-8f23-44b3af537eec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.132318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d28e28-de5f-4e92-8f23-44b3af537eec None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.134135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 169/335] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:57.139598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902098-fc68-4456-960a-f3f7e8d760d2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.140007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902098-fc68-4456-960a-f3f7e8d760d2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.140178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e902098-fc68-4456-960a-f3f7e8d760d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.162703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4e902098-fc68-4456-960a-f3f7e8d760d2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:57.163911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e902098-fc68-4456-960a-f3f7e8d760d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:57.244852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 167/336] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:57.267425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b7f7-b922-4840-9f42-b057d09ab755 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.268031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b7f7-b922-4840-9f42-b057d09ab755 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.268499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9397b7f7-b922-4840-9f42-b057d09ab755 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.270384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 170/337] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:57.275724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282995-0921-4e58-82b0-2f1b1ee245cf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.276020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282995-0921-4e58-82b0-2f1b1ee245cf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.276277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16282995-0921-4e58-82b0-2f1b1ee245cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.295861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-16282995-0921-4e58-82b0-2f1b1ee245cf None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:57.297883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16282995-0921-4e58-82b0-2f1b1ee245cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:57.350386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:57.378544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 168/338] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:57.586780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318371-6ec7-42c1-9dd8-3aa41675ed4a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.587119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318371-6ec7-42c1-9dd8-3aa41675ed4a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.587293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3318371-6ec7-42c1-9dd8-3aa41675ed4a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.588827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 171/339] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:57.593764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.594130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.594415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.621401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:57.622590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:57.703097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 169/340] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:57.705590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318371-6ec7-42c1-9dd8-3aa41675ed4a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:57.842876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3318371-6ec7-42c1-9dd8-3aa41675ed4a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:57.884533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:57.885167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:57.885468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:57.885743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:57.902447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:57.908529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:57.909465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:57.910253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 172/341] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:57 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:57.918299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:57.956946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:57.986495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.095519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7d5d9-3eb7-4ddf-bcb0-23c90cb3c210 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.107461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11ce0f1-08ee-439d-a284-afa71eb58d28 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.129810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.151276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.151917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.152196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.152466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.173037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:58.182575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:58.183524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:58.184321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 173/342] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:57 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:56:58.186591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.187026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.187026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.187261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.188846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:58.190209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.190852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.192441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.208436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 170/343] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:58.231075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.323217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.340154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec0249-d251-4e9d-8a0f-3f1a90f6785e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.386747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.387361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.387638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.387907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.388567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:58.388866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.390270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.410395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 174/344] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:58.411312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.474859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af32f49-41de-48c4-b1ce-ef5c307be19f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.538470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.539734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.540166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.540929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.566007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c260f03-455a-4946-91bc-8ff935419229 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.592640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.610523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.611161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.611435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.611701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.624545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:58.631040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:58.632042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:56:58.632934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:56:58.633579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.634180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06859506-1ae2-426b-9f54-b15c4858723c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.635362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 175/345] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:58.636358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.641993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.757315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94468a47-d93c-4bee-baf9-4db588dadb41 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.780801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 171/346] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 550 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:58.785268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ef91-6583-4448-9581-fbe789bd181d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.785268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ef91-6583-4448-9581-fbe789bd181d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.785268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b605ef91-6583-4448-9581-fbe789bd181d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.785268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 172/347] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:58.785768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ef91-6583-4448-9581-fbe789bd181d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.811629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.812291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.813683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.813970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] PATH_INFO: `/v3/users/fd894de184ea427b95d341a813d6b5bc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.818983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] RBAC: Authorizing `identity:get_user(user_id=fd894de184ea427b95d341a813d6b5bc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.818983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.820209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 176/348] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/users/fd894de184ea427b95d341a813d6b5bc => generated 293 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:58.821009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:58.882702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.910230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:58.918224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b605ef91-6583-4448-9581-fbe789bd181d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.944657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352ed9ad-59a6-4869-b239-274eeff4887a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:58.959084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.960005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.960476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.960960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.961843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:58.962396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.964022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a204834-8c80-4837-a593-ccfa309f6168 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.973476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 173/349] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:58.974980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.975487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.975971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.984019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:58.984019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:58.984237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:58.984536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:58.985730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:58.987174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:58.988952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 177/350] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:58.989686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.001568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:59.003139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:59.084828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 174/351] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:56:59.086079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.128959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70544319-0ecf-43ca-af3d-3a668fe12d5c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.157627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.167227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.167824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.168044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.168316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.169111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] RBAC: Adding query filter params (role.id=347a5a2f29bd4b8e9739e672d687a1a1, user.id=fd894de184ea427b95d341a813d6b5bc, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:59.169456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.171077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.178142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.187058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 178/352] 10.222.0.43 () {56 vars in 1308 bytes} [Thu Sep 1 04:56:58 2022] GET /identity/v3/role_assignments?user.id=fd894de184ea427b95d341a813d6b5bc&scope.system=all&role.id=347a5a2f29bd4b8e9739e672d687a1a1 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:59.193236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.205221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad953b7c-0df3-4612-94b0-a1850231d813 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.261894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.262860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.263331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.263794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.303796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496eec07-4d82-4447-b29b-cdbc3320a7b2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.340732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.341462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.341787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.342067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.348813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.352411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95684ef-2e09-491d-b778-f5e7d980c594 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.354594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 179/353] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:59.355793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbd07-9e7d-400a-9a0f-a8b33fbfb5ca None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.356074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbd07-9e7d-400a-9a0f-a8b33fbfb5ca None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.356345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bbd07-9e7d-400a-9a0f-a8b33fbfb5ca None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.357621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 180/354] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:56:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:56:59.363813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.364103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.364390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.365415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.367075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.386394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:56:59.387642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:56:59.457655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.457839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.473027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 181/355] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:56:59.474345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.493221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 175/356] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:56:59.493221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.597220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778c2ee-3328-497f-a915-554e5a7971b3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.606028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355956c-984f-4830-b3e3-1c24ddbb7aa8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.634977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.635616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.635892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.636160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.647104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:56:59.649218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.650224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.650718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.651191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.652131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=06d169324a4d476f89b7851d153f2121) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:56:59.652618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:56:59.653694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 176/357] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:56:59.654736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.656003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.658378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.664627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 182/358] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=08fff9389c4141b080d31ea8280129d0 => generated 260 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:59.665814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.691175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.730402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.776781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5469a-af43-4b54-826f-ad31e1d4e55d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.811654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153c908e-d1be-458b-b5e3-ecf298791d78 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.815190 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.816064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.816539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.817043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.817925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:56:59.818457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.820034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.830965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 183/359] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:59.836679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.865910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:56:59.866617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:56:59.866904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:56:59.867179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:56:59.868419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:56:59.869991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:56:59.871822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 177/360] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:56:59.873635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:56:59.966027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98cd27c-24c2-4d59-9877-7895bb21050a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:56:59.986437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:56:59.989023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.001106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a876769b-c699-41e2-8f7b-899ea34a9b7d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.008909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.009567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.011041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.011041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.044936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.045976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.046549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.047019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.058918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:00.064460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:00.065416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:00.066313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:00.068274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 178/361] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:00.069293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.092469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.094490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e193b79-7295-497b-93e0-77b61cfba900 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.195033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761e15c-ed0a-48c5-ba17-b1a8eb61ef7c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 184/362] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:56:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acc46-1443-4f92-a7d5-308e4988f57f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acc46-1443-4f92-a7d5-308e4988f57f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271acc46-1443-4f92-a7d5-308e4988f57f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 185/363] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:00.229717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271acc46-1443-4f92-a7d5-308e4988f57f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.252510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.253764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.254042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.254312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.255781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.257520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.258762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.260679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 179/364] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:00.262776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.287501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.369912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271acc46-1443-4f92-a7d5-308e4988f57f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.408024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b2a0f7-9487-4e85-919d-2eefb2d0ca26 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.420542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.421526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.422229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.422841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.423700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:00.424206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.427847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1b33e-2137-4e64-82fc-1d28f8f343da None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.438219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 186/365] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:00.443349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.443349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.443349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.455386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.456027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.456304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.456579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.460428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.461905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.462204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:00.463567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 180/366] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:00.463758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:00.464324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.546624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 187/367] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:00.547376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.565573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.571066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.588965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cecd89-edbb-4eb0-82f8-d0de1bec72a3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.630507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.631200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.631541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.631918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.632702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=06d169324a4d476f89b7851d153f2121) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:00.633073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.634681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.641171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 181/368] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:00.641950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.681833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d01d320-17e3-48c6-8805-a9a06f49b03e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.724738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.724947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.725637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.725979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.773242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed013a61-9fd8-4b0f-adfb-b1fdafcf908a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:00.814472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.816064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.822801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:00.823769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:00.824221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:00.824686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:00.826808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:00.830021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:00.832118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 182/369] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:00.833150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.839273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.866869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:00.958596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 188/370] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:00.967141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:00.988830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478c51c4-0392-4ab9-97f3-fcac7fded4e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.052694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.053673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.054113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.054523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.055382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=b67deb8428b64047a75051b543584c74) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:01.055826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.057406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.064042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 183/371] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=08fff9389c4141b080d31ea8280129d0 => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:01.065350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.085064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eed2a1-b9d5-4cdb-bf01-3facf1caeab9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.098802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:01.127012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.127665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.127947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.128223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.129663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.131465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.133760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 189/372] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:00 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:01.139288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.177113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:01.203546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5f18cc-7200-44ad-a100-87655906a3ad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.253628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.254303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.254547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.254821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.265093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c6c913-0b98-4b35-b07c-0151baefcafa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.274570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:01.285233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:01.286377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:01.287364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 184/373] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:01.289400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.340400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.341407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.341783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.342171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.344960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.345421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.348080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 190/374] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:01.353777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.411446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:01.438930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5650a984-574d-495d-9b85-908fbc097cc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.481111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f79e37-40ef-46f1-ae15-9609178837dd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.487317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.487935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.488213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.488486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.489153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:01.489541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.490910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.506263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 185/375] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:01.514753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.521712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:01.545133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.545826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.546106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.546375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.548208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=b67deb8428b64047a75051b543584c74) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:01.548728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.551559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.564954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 191/376] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:01.665849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc966198-ec44-4252-b9f4-6cff86ac5b60 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:01.711500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:01.712164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.712445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.712772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.797782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:01.799277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea10bb-1ed3-42f1-b49f-a76ff5a02716 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:01.802392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:01.923210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 186/377] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:01.929129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:01.954335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c94-0d64-4f7e-b031-35cb23d55fb7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.954646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c94-0d64-4f7e-b031-35cb23d55fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.954872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba9c94-0d64-4f7e-b031-35cb23d55fb7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.956389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 187/378] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:01.963230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:01.963509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:01.963773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:01.988144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:01.989070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:02.059196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6faf2b-4a8d-434c-beb5-2c5c317bf3eb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:02.072763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:02.097395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 188/379] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:02.102150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:02.102838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:02.103116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:02.103462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] PATH_INFO: `/v3/projects/9091867b04ed42e18d85ad30e6815c4c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:02.104677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] RBAC: Authorizing `identity:get_project(project_id=9091867b04ed42e18d85ad30e6815c4c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:02.106346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:02.108297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 192/380] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:01 2022] GET /identity/v3/projects/9091867b04ed42e18d85ad30e6815c4c => generated 344 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:02.114286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:02.150222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:02.218785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8316dd-af3e-47a9-9ccf-f4b764d5c73d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:02.254002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:02.254733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:02.254898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:02.255434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] PATH_INFO: `/v3/groups/255b6bcdee064f728a35676cdf21ddaa` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:02.261612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] RBAC: Authorizing `identity:get_group(group_id=255b6bcdee064f728a35676cdf21ddaa)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:02.263043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:02.264918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 189/381] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:02 2022] GET /identity/v3/groups/255b6bcdee064f728a35676cdf21ddaa => generated 229 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:02.270759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:02.373207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a239795-0d21-4f1b-9c61-baff6515a13d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:02.403549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:02.411576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:02.412192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:02.412471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:02.412740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:02.413499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] RBAC: Adding query filter params (group.id=255b6bcdee064f728a35676cdf21ddaa, role.id=735711bc5949482f97472a303cdeab41, scope.project.id=9091867b04ed42e18d85ad30e6815c4c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:02.413806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:02.415823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:02.423301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 193/382] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:02 2022] GET /identity/v3/role_assignments?group.id=255b6bcdee064f728a35676cdf21ddaa&scope.project.id=9091867b04ed42e18d85ad30e6815c4c&role.id=735711bc5949482f97472a303cdeab41 => generated 260 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:02.533662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:02.538481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594bea0e-2ef2-482f-b917-3a661082fa43 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:02.581395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:02.582431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:02.582915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:02.583426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:02.595757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:02.601716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:02.602684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:02.603477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:02.608649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 190/383] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:02.614928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:02.671671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:02.750132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c0d380-f779-4827-9936-56c92e03ee9f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:02.792639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:02.793173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:02.793479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:02.793749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:02.794415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:02.794714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:02.796081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:02.805795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 194/384] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:02.812270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:02.965374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-547405ac-2708-4ca4-97f3-c3ef20f35de7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:03.006867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:03.007500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.007776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.008048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.009155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:03.010604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:03.012454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 191/385] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:02 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:03.018619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:03.158731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82c8f20-c7fc-425c-94af-8c23c0d44d30 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:03.161106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:03.206907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:03.207565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.207862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.208115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.209323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:03.210736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7462a469-236d-4507-b7b6-4f43662229cf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:03.212614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 195/386] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:03 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:03.219250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:03.274159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:03.375560 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3c07e4-e1f9-41ad-ad86-778d7ea7d81e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:03.379781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd827-6a9b-4333-ad62-723484634485 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.380506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd827-6a9b-4333-ad62-723484634485 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.380581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861cd827-6a9b-4333-ad62-723484634485 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.382218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 196/387] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:03.387326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172df0-07eb-4f86-add0-9ba049a1cd7a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.387623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172df0-07eb-4f86-add0-9ba049a1cd7a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.387892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60172df0-07eb-4f86-add0-9ba049a1cd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.417670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-60172df0-07eb-4f86-add0-9ba049a1cd7a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:03.418786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-60172df0-07eb-4f86-add0-9ba049a1cd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:03.427317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:03.427988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.428268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.428545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.430661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, group_id=dba04ea3af9b48ba8e482c700e26b58a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:03.432099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:03.460685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 192/388] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 04:57:03 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:03.511156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 197/389] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:03.863811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:03.896482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee1ab-1f03-46dd-a4dc-21ad369632cf None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.896835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee1ab-1f03-46dd-a4dc-21ad369632cf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.897030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98ee1ab-1f03-46dd-a4dc-21ad369632cf None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.898850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 198/390] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:03.919501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:03.919829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:03.920078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:03.961739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:03.963293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:03.980789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:04.004213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf83259-a5c6-4170-8538-e902da71ebc5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.071213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.071852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.072134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.072406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.080860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 199/391] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:04.094737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:04.100052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:04.101012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:04.101894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:04.105535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 193/392] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:04.107066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.157795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:04.232199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc27fcb8-d223-4a66-bc42-7b20922aa5d3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.272887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.273527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.273805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.274075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.274799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:04.275103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:04.276470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:04.286289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 200/393] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:04.291947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.447184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61afc112-115d-4401-9dbd-d7e2b6a80fbd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.487766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.488812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.489439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.489939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.491276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:04.492914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:04.495036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 194/394] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:04 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:04.501544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.518662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.539571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:04.628554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:04.643175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d78d78b-de56-4dbd-8b4d-37b000b14f1d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.662834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934259c-e01d-46b2-a08c-e0aa0ca01063 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.682106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.682755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.683034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.683306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.684547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:04.686022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71e264d-a557-498d-b87b-e52beadd7f39 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:04.688806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 201/395] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:04 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:04.690192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47995-d7ec-4f51-920e-2986b00f57d3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.690481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47995-d7ec-4f51-920e-2986b00f57d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.690846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff47995-d7ec-4f51-920e-2986b00f57d3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.692049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 202/396] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:04.696650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff47995-d7ec-4f51-920e-2986b00f57d3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.699849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.700424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.700704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.700980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.712550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e40f733c-6bf3-4d70-ae9f-f50d84f01b29 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:04.718469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:04.719366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:04.720227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 195/397] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:04.721968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.721968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.721968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.743093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:04.744690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:04.829571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff47995-d7ec-4f51-920e-2986b00f57d3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:04.830813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 196/398] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:04.831985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:04.841478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:04.871135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:04.871808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:04.872089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:04.872364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:04.874658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=06d169324a4d476f89b7851d153f2121, group_id=dba04ea3af9b48ba8e482c700e26b58a, role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:04.876238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:04.894550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 203/399] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 04:57:04 2022] PUT /identity/v3/projects/06d169324a4d476f89b7851d153f2121/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:05.004131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67365f1f-a5eb-4981-b434-6f01119cf9ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.052856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.053530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.053807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.054078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.054797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:05.055098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.056527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.066629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 197/400] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:57:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:05.074297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.102866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.197223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f0626-448d-4b17-a67c-7b3c0938b0c3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.221307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.238967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.239629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.239912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.240189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.241977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.243511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68a4f56-199a-46d3-b27d-2b53543ace36 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.247781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 204/401] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:05.249353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fa6d-194e-4991-94c8-afc3c3ed71d2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.250456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fa6d-194e-4991-94c8-afc3c3ed71d2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.250926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc49fa6d-194e-4991-94c8-afc3c3ed71d2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.252611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 205/402] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:05.254744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fa6d-194e-4991-94c8-afc3c3ed71d2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.321007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.369400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d398b8c6-42a7-4c96-9a6d-48e1d8dbdfb4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.370566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.384858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc49fa6d-194e-4991-94c8-afc3c3ed71d2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.416292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.417562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.418402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.419110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.425277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.425277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.425537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.426007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.428056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.429800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0f582e-21e5-4ffd-bd02-74ff3d21ebeb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.432076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 206/403] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:05.433389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.433671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.433946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.435882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:05.443949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:05.444883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:05.445741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:05.448909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 198/404] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:05.450168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.453917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:05.455291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:05.537535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 207/405] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:05.537535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.639309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d95ca90-2063-44c7-86bf-283a1df782d6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.641515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.664331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80283fc7-c790-4d58-8df7-7aba7171bce9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.681143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:05.702843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.703510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.703788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.704062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.706506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, group_id=dba04ea3af9b48ba8e482c700e26b58a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.707941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.713204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.713819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.714198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.714472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.715138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:05.715503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.716903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.726634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 208/406] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:05.732271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.741852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 199/407] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 04:57:05 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:05.859629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8fdd18-ae38-499c-9e6f-0142b2f5f744 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:05.888046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.917863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:05.919022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:05.919022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:05.919022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:05.920761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:05.922867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:05.924604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 209/408] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:05.930587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:05.952424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:06.092872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724f55c3-b7f3-4ca3-b535-bab5214aff40 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.107600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50daeea8-124e-4ea7-a670-7190ee02c1fe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.148282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.148841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.149123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.149424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.160745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:06.166248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:06.167165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:06.167959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 200/409] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:06.175567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.191404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.192047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.192323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.192591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.193782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:06.195222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdeaf917-4b72-43fc-b27d-aaada972ee5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:06.197128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 210/410] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:05 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:06.198270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f5-6ad8-48d5-bc6f-381a440b734a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.198546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f5-6ad8-48d5-bc6f-381a440b734a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.198815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5ed8f5-6ad8-48d5-bc6f-381a440b734a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.200230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 211/411] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:06.205363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8f5-6ad8-48d5-bc6f-381a440b734a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.226283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:06.304170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a86e8f7-fc0c-490b-bf9a-5e4f301bf055 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.322393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:06.339898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5ed8f5-6ad8-48d5-bc6f-381a440b734a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.351493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.352104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.352381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.352652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.353617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:06.353920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:06.355553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7bf972-c264-4b15-8ce7-ea2b72d3c1cd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:06.370122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 201/412] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:06.371610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.371889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.372160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.378796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.379720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.380612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.381079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.383602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] RBAC: Authorizing `identity:create_grant(project_id=b67deb8428b64047a75051b543584c74, group_id=dba04ea3af9b48ba8e482c700e26b58a, role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:06.385290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:06.392902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:06.394217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:06.404013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 212/413] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 04:57:06 2022] PUT /identity/v3/projects/b67deb8428b64047a75051b543584c74/groups/dba04ea3af9b48ba8e482c700e26b58a/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:06.409621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.527344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 202/414] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:06.599265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe3a50f-20e6-49f9-aa25-f4bdcd577df7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.641005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.642001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.642489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.642972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] PATH_INFO: `/v3/groups/255b6bcdee064f728a35676cdf21ddaa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.644973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] RBAC: Authorizing `identity:get_group(group_id=255b6bcdee064f728a35676cdf21ddaa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:06.646621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:06.648395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 213/415] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:06 2022] GET /identity/v3/groups/255b6bcdee064f728a35676cdf21ddaa => generated 229 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:06.654156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.714857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:06.792079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c0415-d4e0-4973-bad2-d257cd19ab72 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:06.835004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:06.835631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:06.835904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:06.836240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] PATH_INFO: `/v3/projects/9091867b04ed42e18d85ad30e6815c4c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:06.837387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] RBAC: Authorizing `identity:get_project(project_id=9091867b04ed42e18d85ad30e6815c4c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:06.838823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:06.840911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 203/416] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:06 2022] GET /identity/v3/projects/9091867b04ed42e18d85ad30e6815c4c => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:06.847224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.870574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:06.959047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:06.996559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b82fc2b-c84d-41bb-94d9-51ff13bc3bfc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:07.035544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:07.036267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.036548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.036822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] PATH_INFO: `/v3/projects/9091867b04ed42e18d85ad30e6815c4c/groups/255b6bcdee064f728a35676cdf21ddaa/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.038798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] RBAC: Authorizing `identity:create_grant(project_id=9091867b04ed42e18d85ad30e6815c4c, group_id=255b6bcdee064f728a35676cdf21ddaa, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:07.040810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:07.060216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 214/417] 10.222.0.43 () {58 vars in 1442 bytes} [Thu Sep 1 04:57:06 2022] PUT /identity/v3/projects/9091867b04ed42e18d85ad30e6815c4c/groups/255b6bcdee064f728a35676cdf21ddaa/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:07.120581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94459a-57ad-4c31-9147-fa736a597d10 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:07.130543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.163461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:07.164158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.164443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.164718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.177714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0852de5a-401c-46b0-a326-5331e911e3fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:07.182888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:07.183905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:07.184696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 204/418] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:07.192229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:07.281846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.293875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e748-b7d7-4531-8415-fe363448747f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.293875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e748-b7d7-4531-8415-fe363448747f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.294111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b1e748-b7d7-4531-8415-fe363448747f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.295773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 205/419] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:07.302668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.303114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.303459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.312074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73d991-6c41-462b-8db3-cc6b813fc97f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:07.325035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:07.326430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:07.350138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:07.351048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.351600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.352050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.352894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:07.353388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:07.355029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:07.365043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 215/420] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:57:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:07.374199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:07.414877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 206/421] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:07.505555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b30caf-337f-474b-90df-dcaf82309ea8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:07.540470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:07.541009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.541315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.541592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.545065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.625485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:07.627112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:07.738401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 216/422] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:07.743783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:07.773317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:07.839827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.853208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d581ee-db3a-498e-acf2-15b8d1aca1b3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:07.854783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:07.893551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:07.894711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:07.894711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:07.894953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:07.901285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:07.901285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:07.901285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 207/423] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:07 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:07.905059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:07.987152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b6f3dc-30b0-4416-86dd-b567c987771c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.017669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f2c9d2-0a48-4db5-9b4c-df5db9c32ec2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.024774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.025450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.025731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.026003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.046018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-dee1369d-0964-4deb-b1dd-fd6b77044a6a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:08.053161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:08.054090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:08.054907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:08.057530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 217/424] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:08.058977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7243fa-a4a6-4a94-8db0-fd82c0075b6d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.059403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7243fa-a4a6-4a94-8db0-fd82c0075b6d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.059822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7243fa-a4a6-4a94-8db0-fd82c0075b6d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.066090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 218/425] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:08.066236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7243fa-a4a6-4a94-8db0-fd82c0075b6d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.079511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.080254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.080775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.081681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.082821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:08.084752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea2b85-a59c-43e1-a73b-0c8d8ed03721 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:08.087061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 208/426] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:07 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:08.089229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.089516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.089803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.113438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:08.115517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:08.149377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.196774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.205215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 209/427] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:08.205215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.215825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7243fa-a4a6-4a94-8db0-fd82c0075b6d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.281405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.282042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.283462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.283777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.284458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:08.284761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:08.286187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:08.303635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 219/428] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:08.310213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.407966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7891171-6109-4c0b-950f-c991c857e68c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.430804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6405e0d6-fc73-467b-a155-94371ece68fb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.473692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.474729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.475009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.475280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.505421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.505932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.510587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.510587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.510587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.510587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=06d169324a4d476f89b7851d153f2121) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:08.510587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:08.513565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:08.524488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 210/429] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=08fff9389c4141b080d31ea8280129d0 => generated 611 bytes in 324 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:08.552166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:08.553695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:08.580762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.647227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.689499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 220/430] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:08.695679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.764536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.775121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d929ae-b532-4b1f-988e-eba23bcba646 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.810092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a625da68-fad8-4074-969a-4d0bed86cd8d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.817017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.817992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.818415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.818914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.830187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:08.835921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:08.837004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 01 04:57:08.838006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:08.840283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 211/431] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:08.850518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.852221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:08.852879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:08.853163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:08.853462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] PATH_INFO: `/v3/projects/06d169324a4d476f89b7851d153f2121` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:08.854604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] RBAC: Authorizing `identity:get_project(project_id=06d169324a4d476f89b7851d153f2121)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:08.856057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:08.864160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 221/432] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/projects/06d169324a4d476f89b7851d153f2121 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:08.865492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:08.964596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:08.989078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce0b78-a6d9-47c3-bc53-993e4ac143a8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:08.999049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9097d7c6-46ef-4d20-88cd-2e4f29c2a364 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.035823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.040361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.040919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.041331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.041603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.043997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:09.043997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.044994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.049906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.050554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.050832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.051100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.052221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.053726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3a962d-ec36-44fa-883e-f2fdbc3764ac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.055598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 222/433] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:09.056731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c2f-f8d7-4cce-9121-3e535d4b1849 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.057011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c2f-f8d7-4cce-9121-3e535d4b1849 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.057785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3b1c2f-f8d7-4cce-9121-3e535d4b1849 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.058110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 212/434] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:57:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:09.059292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 223/435] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:09.063000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.065017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.065332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.065611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.085338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:09.086521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:09.170823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 224/436] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:09.171846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.190778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f734b7b-76b3-4584-8d5d-8b726084fb47 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.226719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.227350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.227716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.228058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.228853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=06d169324a4d476f89b7851d153f2121) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:09.229270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.231110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4c2f55-586e-4273-b168-b6280755797d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.238370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 213/437] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=06d169324a4d476f89b7851d153f2121&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 611 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:09.290356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b45a37-235c-4b82-89ef-33b936dd96f9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.317916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.330568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.331201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.331478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.331803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.397505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8e3e0-b3fe-45de-a69d-334488af2f20 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.398157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8e3e0-b3fe-45de-a69d-334488af2f20 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.398633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee8e3e0-b3fe-45de-a69d-334488af2f20 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.400541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 214/438] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:09.406474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.407099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.407615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.420306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.422945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.428885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:09.430117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:09.438973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.516371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 215/439] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:09.517163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.552033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 225/440] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:09.556874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.588222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.651097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b498a546-9fbc-4031-81b8-c90c2f9adad4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.686754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211bd7cd-2921-42fa-9039-3f484bc35a64 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.692526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.693315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.693690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.694054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.708390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:09.713178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:09.714082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:09.715762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 216/441] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:09.722917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.729418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.735470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.736230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.736381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.736623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.737835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.739272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.740894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 226/442] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:09.746232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.831858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6995f20-30ed-419c-abb5-e1748323bd14 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.838299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.848021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2480f2-80b6-4955-b899-42fcaca617a3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.867010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.867607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.867888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.868155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.868811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:09.869132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.870514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.878301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 217/443] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:09.879073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.881781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:09.882414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:09.882695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:09.883153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:09.884239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:09.885715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:09.891800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 227/444] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:09.891800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:09.945550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:09.983249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8107816-f881-42ff-b4c4-f74556e8a2dd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:09.987626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83714cbc-f356-4051-a50f-cc5bc0d1db0a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.018050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.018665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.018942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.019215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.021418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.022023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.022300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.022573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.029346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:10.035070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:10.036028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:10.037025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 218/445] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:10.038013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.054578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.095280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.096755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.137820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca13a57c-0e77-4dd2-8eef-fbd469d773fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.160725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.172953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.173576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.173853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.174128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.174842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=08fff9389c4141b080d31ea8280129d0, scope.project.id=b67deb8428b64047a75051b543584c74) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:10.175151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.176565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.182355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 219/446] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=08fff9389c4141b080d31ea8280129d0 => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:10.183113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.194269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 228/447] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:10.200118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.266564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.303688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68412be-6e13-44c5-a07f-a1934dafb3cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.317472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e4feb1-df74-4ccd-b339-16be34d480e7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.347080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.347615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.347891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.348161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.348896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:10.349220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.350594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.360244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 220/448] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:10.361055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.361727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.362000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.362270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] PATH_INFO: `/v3/projects/b67deb8428b64047a75051b543584c74` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.363399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] RBAC: Authorizing `identity:get_project(project_id=b67deb8428b64047a75051b543584c74)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.364824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.366137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.367368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 229/449] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/projects/b67deb8428b64047a75051b543584c74 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:10.372732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.426371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.485106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c70740-930e-4a8c-9404-7825f8083686 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.502521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37bc34c-4633-4c03-a0bc-b26612cdf606 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.524934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.525580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.525858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.526140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.544750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.553541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.554182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.554460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.554732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] PATH_INFO: `/v3/groups/dba04ea3af9b48ba8e482c700e26b58a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.555852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] RBAC: Authorizing `identity:get_group(group_id=dba04ea3af9b48ba8e482c700e26b58a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.557306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.558868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 230/450] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/groups/dba04ea3af9b48ba8e482c700e26b58a => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:10.565086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.598493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.599854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.646589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.662714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a06d88-3b52-4d23-8966-9fd15d470036 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.697002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 221/451] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:10.703311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.703474 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.704004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.704282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.704551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.705305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] RBAC: Adding query filter params (group.id=dba04ea3af9b48ba8e482c700e26b58a, role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=b67deb8428b64047a75051b543584c74) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:10.705609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.707045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.712970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 231/452] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/role_assignments?group.id=dba04ea3af9b48ba8e482c700e26b58a&scope.project.id=b67deb8428b64047a75051b543584c74&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 611 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:10.805081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc7b1f-4906-4adc-96c3-50cf2cd5c670 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.840918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.841576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.841852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.842122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] PATH_INFO: `/v3/projects/9091867b04ed42e18d85ad30e6815c4c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.843279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] RBAC: Authorizing `identity:get_project(project_id=9091867b04ed42e18d85ad30e6815c4c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.844694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:10.846508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 222/453] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/projects/9091867b04ed42e18d85ad30e6815c4c => generated 344 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:10.852288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:10.913370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:10.961746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af64e13-55ce-42c1-b9d4-4f2577f59406 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:10.995195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:10.995827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:10.996107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:10.996378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] PATH_INFO: `/v3/groups/255b6bcdee064f728a35676cdf21ddaa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:10.997523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] RBAC: Authorizing `identity:get_group(group_id=255b6bcdee064f728a35676cdf21ddaa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:10.999009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6051855b-056c-4eb0-b7c3-0a4636c31b32 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:11.000584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 232/454] 10.222.0.43 () {56 vars in 1180 bytes} [Thu Sep 1 04:57:10 2022] GET /identity/v3/groups/255b6bcdee064f728a35676cdf21ddaa => generated 229 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:11.006745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:11.026567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:11.107307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff8693-e71b-4b90-a92f-13e91f7f2948 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:11.140758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:11.141381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:11.141663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:11.141938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:11.142668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] RBAC: Adding query filter params (group.id=255b6bcdee064f728a35676cdf21ddaa, role.id=735711bc5949482f97472a303cdeab41, scope.project.id=9091867b04ed42e18d85ad30e6815c4c) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:11.142978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:11.144411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21197cd0-b648-4bb6-93b3-d89ef558c8c4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:11.150958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 223/455] 10.222.0.43 () {56 vars in 1376 bytes} [Thu Sep 1 04:57:11 2022] GET /identity/v3/role_assignments?group.id=255b6bcdee064f728a35676cdf21ddaa&scope.project.id=9091867b04ed42e18d85ad30e6815c4c&role.id=735711bc5949482f97472a303cdeab41 => generated 611 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:13.541534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa314-cff0-42c9-b576-df4a8ee8f5ae None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:13.542050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa314-cff0-42c9-b576-df4a8ee8f5ae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:13.542125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7caa314-cff0-42c9-b576-df4a8ee8f5ae None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:13.543407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 233/456] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:13.548666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a40ed-1925-4287-973f-cde180793f5d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:13.549099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a40ed-1925-4287-973f-cde180793f5d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:13.549289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610a40ed-1925-4287-973f-cde180793f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:13.574633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-610a40ed-1925-4287-973f-cde180793f5d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:13.575825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-610a40ed-1925-4287-973f-cde180793f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:13.659465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 224/457] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:13.878150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c21f-1a93-45b0-9c04-56e964661cb9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:13.878520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c21f-1a93-45b0-9c04-56e964661cb9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:13.878700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf3c21f-1a93-45b0-9c04-56e964661cb9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:13.880555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 234/458] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:13.885519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb03cf-1e0d-44bf-9724-1f5725d5a43d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:13.885808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb03cf-1e0d-44bf-9724-1f5725d5a43d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:13.886084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb03cf-1e0d-44bf-9724-1f5725d5a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:13.910168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-42fb03cf-1e0d-44bf-9724-1f5725d5a43d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:13.911370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42fb03cf-1e0d-44bf-9724-1f5725d5a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:13.919127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.001590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 225/459] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:14.020463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3c21f-1a93-45b0-9c04-56e964661cb9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.089538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc4e5-4656-49e6-b2b4-45fecd55cd5e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.089855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc4e5-4656-49e6-b2b4-45fecd55cd5e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.090089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acfc4e5-4656-49e6-b2b4-45fecd55cd5e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.091975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 226/460] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:14.097788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22edb8-e6cd-4bb2-9169-0b922c4fd243 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.098076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22edb8-e6cd-4bb2-9169-0b922c4fd243 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.098357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f22edb8-e6cd-4bb2-9169-0b922c4fd243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.121751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9f22edb8-e6cd-4bb2-9169-0b922c4fd243 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:14.123252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f22edb8-e6cd-4bb2-9169-0b922c4fd243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:14.154057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf3c21f-1a93-45b0-9c04-56e964661cb9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.201429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.215870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.217542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.218245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.218527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.220731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 227/461] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:14.242254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.243720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:14.269356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:14.270382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:14.271261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:14.271261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.271261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:14.271261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 235/462] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:14.277904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd203c-d062-49a2-9f01-0f84c500ab14 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.278192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd203c-d062-49a2-9f01-0f84c500ab14 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.278461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dd203c-d062-49a2-9f01-0f84c500ab14 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.279814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 228/463] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:14.281618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.290169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.290454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.290734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.321982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:14.323188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:14.437416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 229/464] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:14.438697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.441142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.464753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72adb7b-5925-4459-9b70-9926d77a7c0f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.533794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.535620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.536919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.537574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.539232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:14.539566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.540944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.560630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 236/465] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:14.566741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.596595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0766c19-06ff-4731-a012-dd782aaf64a2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.613282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.633700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.634637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.635119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.635615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.646199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.647995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:14.663573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:14.664538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:14.665398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:14.665398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.665398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:14.672873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 230/466] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:14.674003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.684990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c82ef-dabf-4e66-9e4a-89e6c018fc78 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.726306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.727303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.727984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.728408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.732916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.741779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.743254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:14.764114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:14.765696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:14.766577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:14.766577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:14.766577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:14.767308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 237/467] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:14.768392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.782735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d729730-6b8c-42a0-93f1-420c85dcfe02 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.821400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.822240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.822666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.823085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.824026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.825570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.857243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 231/468] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:14 2022] POST /identity/v3/users => generated 246 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:14.857243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.878361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:14.892228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4238226f-f27a-41a6-99aa-9171ef12dfc6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:14.955446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:14.956359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:14.957047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:14.957563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:14.959353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:14.959828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:14.961457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:14.980275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 238/469] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:14.981784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:14.994618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca02b35f-cf82-4762-8af4-01f69e44f6dd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.007427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:15.043299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.044087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.044377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.044653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.057519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.058792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:15.075600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:15.076554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:15.078058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:15.078058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:15.078058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:15.078058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 232/470] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:15.078722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:15.117642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c6d31b-801b-4b6c-8ba0-fc44b3f08c9a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.162906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.163526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.163805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.164077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.164787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:15.165093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.166772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.181296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 239/471] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:15.182529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:15.198857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:15.203453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c715c2-592b-4221-b534-8042c9967274 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.241580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.242268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.242535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.242809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.243505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.245218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.268580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 233/472] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:15 2022] POST /identity/v3/users => generated 248 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:15.269440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:15.301815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:15.309227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dac9cd2-037d-432c-9d57-47ab3310b918 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.359275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.359902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.360181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.360480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.361388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:15.361698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.363945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12ba0f-7773-479f-b8b4-73a3a02560a2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.381302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 240/473] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:15.382790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b217e-820f-46c7-9cb2-b1625db9d011 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.383076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b217e-820f-46c7-9cb2-b1625db9d011 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.383792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a39b217e-820f-46c7-9cb2-b1625db9d011 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.390328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 241/474] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:15.390328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b217e-820f-46c7-9cb2-b1625db9d011 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:15.409641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8add1e47-be40-4541-aed4-3f8d6223aa3d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.452891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.454012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.454906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.454906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.455389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.456991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e709c7e-b28b-4a7b-b119-d8ec428112bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.489213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 234/475] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:15 2022] POST /identity/v3/users => generated 248 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:15.489213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.489213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.489213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.493276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:15.509482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:15.510692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:15.523603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a39b217e-820f-46c7-9cb2-b1625db9d011 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:15.566376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:15.567080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:15.567357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:15.567633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:15.568289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:15.569837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:15.596562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 242/476] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:15 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:15.600809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 235/477] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:15.883776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:16.028951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4a004-3564-4ce8-84e4-69ff06a45e03 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:16.055975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:16.066052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:16.066670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:16.066950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:16.067227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:16.067906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:16.069314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:16.078995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.sql.core [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 04:57:16.078995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 04:57:16.078995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [parameters: {'id': '9837a9d0d2914c4e9c06acefec71d2d5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 04:57:16.078995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Sep 01 04:57:16.096325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return ref.to_dict() Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:57:16.097286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application yield resource Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise self.value Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application session.commit() Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 04:57:16.098224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.flush() Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application compat.raise_( Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:57:16.099783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:57:16.100874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:57:16.101908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [parameters: {'id': '9837a9d0d2914c4e9c06acefec71d2d5', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:16.103019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 01 04:57:16.103823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:16.104638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 243/478] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 04:57:15 2022] POST /identity/v3/roles => generated 144 bytes in 215 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:16.109209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:16.111138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:16.276327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145bba18-4c09-48ef-8765-3caad770d7e5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:16.323824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:16.324458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:16.324734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:16.325001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:16.343675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-92cc40b6-f855-4a24-bb76-075d807e93b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:16.348461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:16.350631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:16.352581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 236/479] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:16.357217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:16.530575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c7402-ebbf-4789-beab-cedce324491f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:16.587257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:16.588695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:16.589175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:16.589672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:16.590565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:16.591068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:16.593211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0041d7-ace8-4a56-8f43-b60dde3b4fc3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:16.604654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 244/480] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:16.995611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f6a6-651b-4d17-9869-26d1383b5d52 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:16.996244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f6a6-651b-4d17-9869-26d1383b5d52 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:16.996448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a7f6a6-651b-4d17-9869-26d1383b5d52 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:16.998099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 237/481] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:17.004251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:17.004815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:17.005328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:17.025966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:17.027553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:17.082333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:17.103607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 245/482] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:17.532601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f6a6-651b-4d17-9869-26d1383b5d52 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:17.618600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:17.665390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a7f6a6-651b-4d17-9869-26d1383b5d52 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:17.699120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:17.699748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:17.700021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:17.700293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:17.711233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9ceb7536-3f83-4554-a173-61820afeb587 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:17.715944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:17.717058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:17.719005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 238/483] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:17.730326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:17.880878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9764648-eb60-42c2-9469-4e3b5bf3c3cb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:17.922593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:17.923560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:17.924072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:17.924556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:17.925450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:17.925958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:17.927531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:17.944136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab146a7-928e-46b0-af4f-1198ac259601 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:17.944754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 246/484] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:17.945210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab146a7-928e-46b0-af4f-1198ac259601 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:17.945662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab146a7-928e-46b0-af4f-1198ac259601 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:17.947366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 239/485] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:17.954366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:17.955215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a59-0f8e-470a-aeaf-c9db94644694 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:17.955506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a59-0f8e-470a-aeaf-c9db94644694 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:17.955789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa21a59-0f8e-470a-aeaf-c9db94644694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:17.994182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dfa21a59-0f8e-470a-aeaf-c9db94644694 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:17.995398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfa21a59-0f8e-470a-aeaf-c9db94644694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:18.003528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.081223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd9b36-f6de-4c96-9b43-4246e1316ee9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.131497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 240/486] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:18.134063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2981f-31f8-43c0-91cd-8fbf6fc5136e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.134349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2981f-31f8-43c0-91cd-8fbf6fc5136e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.134625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da2981f-31f8-43c0-91cd-8fbf6fc5136e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.136122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 241/487] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:18.142315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaacc2-db65-41de-9d17-3b9989e776f6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.142671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.142962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaacc2-db65-41de-9d17-3b9989e776f6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.143387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aeaacc2-db65-41de-9d17-3b9989e776f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.143498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.143769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.144049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.157016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:18.160080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:18.164504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3aeaacc2-db65-41de-9d17-3b9989e776f6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:18.166015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3aeaacc2-db65-41de-9d17-3b9989e776f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-04546b46-d372-476e-b1cb-dd59a1dc4d8e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:18.178489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:18.179460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:18.180344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:18.180344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:18.180344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:18.180344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 247/488] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:18.181432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38233c2-9e84-44e3-8433-1b85578b6298 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.181718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38233c2-9e84-44e3-8433-1b85578b6298 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.181992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38233c2-9e84-44e3-8433-1b85578b6298 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.183456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 248/489] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:18.185380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38233c2-9e84-44e3-8433-1b85578b6298 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.233176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.258738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 242/490] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:18.260635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.261140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.261636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.284221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:18.285806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:18.325419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.331653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38233c2-9e84-44e3-8433-1b85578b6298 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.397588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.398117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.398397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.398669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.399315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:18.399614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:18.401001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:18.424439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 249/491] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:18.430305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 243/492] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:18.431655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.476754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.577172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa95ba6-c0b7-4a3d-a6cc-df15104cd2de None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.599091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15b7a6f-1c01-4efe-9ea0-db71d382e2dc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.613552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.615267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.617161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.617161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.617161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.626284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:18.628024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:18.635656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.636366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.636711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.637054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:18.643150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:18.644237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:18.645887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 250/493] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:18.650104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.651102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:18.656739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:18.658935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 244/494] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:18.661129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.671309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.765303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6367c990-f820-4d3f-bc49-bb573e9c9dfa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.765976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae7ad97-e3f4-4565-917e-e0093c9224d1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.803443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.803677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.804039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.804219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.804311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.804469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.804562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.804740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.805299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:18.805599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:18.807025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:18.815731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:18.821007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:18.821915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 251/495] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:18.826103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.850082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 245/496] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:18.851222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:18.884838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.911671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:18.934765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41898207-c77e-4532-aff5-970985b56a48 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.966891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bea6bda-21d3-4d46-ae0f-9115cba97cc7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:18.970628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:18.971243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:18.971523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:18.971795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:18.972458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:18.972765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:18.974212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:18.983388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 252/497] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:18.984434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.008178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.008808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.009102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.009475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.019952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:19.024903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.025820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:19.026656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 246/498] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.027320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.091040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df3665c-fcbf-420e-8e2f-6fc9951bc00b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.121349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.126017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.126628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.126904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.127175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.127836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:19.128136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.129931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.132907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0b40ef-c170-4398-9e4f-89a28e0c0918 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.141451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 253/499] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:19.143440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.147554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.175587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.176112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.176389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.176667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.252772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.254522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.254677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978903ed-2648-4dc0-ba03-7c2c51ea927b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.287922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.288542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.288814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.289082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.299740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.301174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:19.315401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.316314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:19.317642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:19.317642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.317642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:19.317642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 254/500] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.317642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.347501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.362181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 247/501] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:19.362181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.371163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.417539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc084dc-885f-4d25-9e4d-0241e8921358 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.449754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.450286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.450569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.450842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.452097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:19.452404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.453809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6eafe77-37ef-4514-a167-9f7e0b2974fc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.455355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57418b2d-537d-443f-babc-f7f523d7871a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.461482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 255/502] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:19.462648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0179f-213e-4a8c-bd63-067019420ff1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.462934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0179f-213e-4a8c-bd63-067019420ff1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.463210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0179f-213e-4a8c-bd63-067019420ff1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.464662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 256/503] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:19.465286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0179f-213e-4a8c-bd63-067019420ff1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.491799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.492413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.492686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.492960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.502570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.504287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:19.519328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.520256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:19.521121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:19.521121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.521121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:19.521121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 248/504] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.521367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.569483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.569859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0179f-213e-4a8c-bd63-067019420ff1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.586496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.603595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b6b15-de37-4920-adde-84128996e308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.604198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b15-de37-4920-adde-84128996e308 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.604476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b15-de37-4920-adde-84128996e308 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.604751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440b6b15-de37-4920-adde-84128996e308 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.605418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b6b15-de37-4920-adde-84128996e308 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:19.605724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b6b15-de37-4920-adde-84128996e308 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.607086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440b6b15-de37-4920-adde-84128996e308 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.618579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 257/505] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:19.619359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b6b15-de37-4920-adde-84128996e308 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.622499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84b106d-2495-4dad-be3d-b77dabd45fb3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.656310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.656926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.657228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.657506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.667558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.668982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-954fb952-117d-411a-8aaf-1d9d6c9d28c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:19.682545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.683636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:19.684518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:19.684518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.684518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:19.684518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 249/506] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.684736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.685039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.685300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.703264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:19.704386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:19.721712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440b6b15-de37-4920-adde-84128996e308 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.755604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.756219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.756498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.756779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.766478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.767975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.770836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 250/507] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:19.771651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:19.783092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.784029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:19.784881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:19.784881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:19.784881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:19.784881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 258/508] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.785104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.806993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.820288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:19.883951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c34a04-3f98-4c62-969e-5bd2e4e83bc4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.901839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede221a4-7b52-409f-baeb-0e0a6956ef2a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:19.921381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.921987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.922266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.922534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.923162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:19.923706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.924820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.940392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:19.941064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 251/509] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:19.941383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:19.941670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:19.941948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:19.942044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:19.953449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:19.955206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:19.968809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:19.969970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 259/510] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:19.971609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.041906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.058338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68950f42-c7af-4792-8dcc-f8ffb0c56ff3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.067331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.079574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8980b52-6de4-4b68-a5e2-6dfbe655f85b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.093815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.094418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.094696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.094967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.095610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.095912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.097319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.109273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 252/511] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.110218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.112825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.113461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.113930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.114050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.114644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.114951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.116306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.129006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 260/512] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.129908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.212001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98141af5-0800-46eb-b324-f31af3a61e5a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.226898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affaea55-f08a-4d9f-95f0-69bd43c825aa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.245091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.245739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.246017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.246290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.254245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.255680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.260824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.261443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.261726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.261994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.262715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.263016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.264919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:20.269208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:20.270277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 253/513] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:20.271185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.282741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.302588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 261/514] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.303423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.312203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.376451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7bd64a2-a47e-4fe5-be92-c4fbf832a097 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.404377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a286f85d-f7d4-4359-b9ef-53e6431e60a2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.410293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.410911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.411185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.411850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.422524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.423961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.438243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:20.438397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:20.439463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:20.440319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:20.440319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:20.440319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:20.440485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.440485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.440621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 254/515] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:20.440687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.440761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.449923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.452415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:20.464273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:20.465113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:20.466000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 262/516] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:20.466499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.501812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.532233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.543296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9f8199-4825-4bc7-976d-ed0c0c0a192e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.567751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8de0a6b-5491-41f6-b9ea-8eddd1515faa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.575878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.576701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.577063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.577398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.584576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.586042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:20.598091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:20.599158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 255/517] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:20.600124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.605163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.605793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.606073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.606352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.607080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.607384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.609762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.627277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 263/518] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.628080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.703636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cad2d6-c474-442d-bb3e-5ee036c3b95a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.720909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.726552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb73814a-ee45-4694-a130-10569c9fdf0e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.737648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.738249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.738530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.738806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.749380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.760142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.760735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.761023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.761319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.761953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.762253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.763608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.775217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 264/519] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.776011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.813790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.815518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.879709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecff30c-0c4e-40dc-9692-89f101e0a8f3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:20.912727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:20.913361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:20.913643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:20.913919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:20.914610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:20.914917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:20.915121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 256/520] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:20.915973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.916410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:20.934369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 265/521] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:20.934527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:20.935088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:20.984078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.019123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29482572-696f-4580-b1d0-0eeeffea248c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.037584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f5bc3e-43ff-43cd-9369-4c6a71174736 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.051752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.052351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.052627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.052898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.053645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:21.053954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.055369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.070541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.071136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.071411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.071678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.072340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 257/522] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:21.073220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.140040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.141541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.148510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.175930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281b489-1a8d-4704-83f1-8c9fa73ec5e7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.187228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.210934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.211544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.211827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.212102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.212740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.214192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.236481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 258/523] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:21 2022] POST /identity/v3/users => generated 247 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:21.237255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.243214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 266/524] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:21.244095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.357929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2e1cb-ddce-4410-b80d-995f6e45b22b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.363808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb299b0-af98-4a97-9740-b353051b9ccd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.397355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.403363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.403860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.404121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.404432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.405716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.406327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.406855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.407129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.407858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:21.408162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.409640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.416818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 267/525] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:21.417293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.418739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.418928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:21.438074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:21.439078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:21.440409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:21.440409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:21.440409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:21.440409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 259/526] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:21.440409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.450241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.572675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf095b94-c7ea-421d-803f-62b2dcea22d8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.580080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbfd2eb-01da-42b0-a99c-46d767755927 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.611388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.612320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.612770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.613265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.629127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.629790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.630505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.630800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.646699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.648847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:21.667831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:21.668817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:21.669704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:21.669704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:21.669704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:21.669704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 260/527] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:21.670705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.696532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.698013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.708841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.723259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.800166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3636fe1f-f3b1-49e3-a1ae-9b71e43b9f00 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.807046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 268/528] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:21.807896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.838287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.839215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.839783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.840259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.841137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:21.841676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.843512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.855985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 261/529] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:21.857666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.914929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fcbaf0e-dc44-4db4-adda-9b2b98a98467 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:21.928233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.960977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:21.961829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:21.962114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:21.962387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:21.963030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:21.963587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:21.965043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:21.975032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:21.981311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 269/530] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:21.982155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:21.984046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69ce84b-35f1-4802-a1c5-599b62fa60ca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.027588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.028608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.030062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.030341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.043134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.044785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:22.066144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:22.067089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:22.067923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:22.067923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:22.067923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:22.070569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 262/531] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:22.071654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.101002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398c3805-ed44-425e-a850-d86edde1e147 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.138287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.140069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.140636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.141133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.148868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.150583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:22.164365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:22.165269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.166278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:22.168274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 270/532] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:22.169382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.179348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85120724-2d52-4525-83e5-a482f335f6b0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.200778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.214081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.214701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.214978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.215248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.222613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.224052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:22.236421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:22.237476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:22.238575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 263/533] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:22.239035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.250353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.287679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3580775-b866-4077-967d-38b0aabcfb2f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.326191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.327115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.327533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.327944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.328821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.329283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.330806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.340848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284d50-dbf7-4378-857a-95171dcc1bd7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.344274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 271/534] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.345510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.376044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.376646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.377161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.377161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.377885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.378218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.379860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.399852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 264/535] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.400748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.446001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.461412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def81dd9-5a66-400e-9f8c-d384509d2863 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.470192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.501155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.502020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.502439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.502850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.503910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab8d2ae-2019-4246-8ae3-0ba1d6097106 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.504110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.504576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.506441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.519961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 272/536] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.521162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.539343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.539970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.540301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.540566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.547468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.548900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:22.561541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:22.562613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:22.563752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 265/537] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:22.564298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.636610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3106f3b7-ea88-4f52-8201-33f48f7baf3e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.664371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a6c97c-7d8a-4391-b35f-a0ec7f956908 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.674052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323086-5592-450f-9395-e2691d62578a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.674874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323086-5592-450f-9395-e2691d62578a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.675401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323086-5592-450f-9395-e2691d62578a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.675811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b323086-5592-450f-9395-e2691d62578a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.676677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323086-5592-450f-9395-e2691d62578a None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=b1e3deabee4f46cb9e0c15f94e5ab23d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.677137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323086-5592-450f-9395-e2691d62578a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.678974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b323086-5592-450f-9395-e2691d62578a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.686050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 273/538] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/role_assignments?user.id=b1e3deabee4f46cb9e0c15f94e5ab23d&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.687068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323086-5592-450f-9395-e2691d62578a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:22.692232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.701052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.702255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.702894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.703530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.704343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=76b44e52d3524340925fd7d7e2273763) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.704764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.706270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.708828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:22.712779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 266/539] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/role_assignments?user.id=76b44e52d3524340925fd7d7e2273763&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.814579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b323086-5592-450f-9395-e2691d62578a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:22.854309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:22.854930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:22.855207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:22.855477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:22.856209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:22.856515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:22.858098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95363c7-cb24-4b08-ac32-ff80fa09ddcf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:22.871623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 274/540] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:22.877628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:23.028602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0013a1-52c3-4680-92c9-dc405629c8f3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:23.066094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:23.066705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.067050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.067331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.068062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fec5602226564e6b95baf1ab9824ff0f) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:23.068372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:23.069858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d819227-2d8f-44e3-9f04-53456dc9c3c7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:23.075816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 267/541] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:22 2022] GET /identity/v3/role_assignments?user.id=fec5602226564e6b95baf1ab9824ff0f&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:23.432143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6caf-b918-4d88-a584-071c50943edf None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.432543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6caf-b918-4d88-a584-071c50943edf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.432736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c6caf-b918-4d88-a584-071c50943edf None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.434379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 275/542] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:23.440555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.441019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.441116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.463735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:23.464909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:23.519141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:23.523478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e8c1-b833-4b39-8ec3-4260bc4bafae None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.523766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e8c1-b833-4b39-8ec3-4260bc4bafae None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.524043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df53e8c1-b833-4b39-8ec3-4260bc4bafae None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.529762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 276/543] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:23.535390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.535676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.535944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 268/544] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:23.536126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.566635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:23.567887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:23.658826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 277/545] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:23.824905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:23.929170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22609de5-4f15-4432-869a-5f9cc47cbdd7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:23.964541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:23.965169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:23.965466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:23.965738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:23.976850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:23.981797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:23.984287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:23.985409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 269/546] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:23.989487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:23.994086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.009655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.073156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.127405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ca6c-563e-4b32-8c68-da49f0bb11e5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.163004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.163810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.164283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.164654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.185655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:24.198972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:24.200085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:24.201135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:24.205133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 270/547] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:24.212091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.259404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47c8882-7f52-45e9-9dad-9a2afd4b0d56 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.334262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.335162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.335590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.336009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.336824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:24.337295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:24.338820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:24.359790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 278/548] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:24.366153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.414723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d552487-c572-46c7-b8a1-63d15f1bb8fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.431451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.457935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.458604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.458817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.459092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.459763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:24.460064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:24.461687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:24.481424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 271/549] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:24.487658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.513367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.570139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6070061b-26d1-4740-9653-b8a5205414b8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.607053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.608229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.608513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.608789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.620236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:24.621817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:24.639623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:24.640777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:24.641995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:24.641995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:24.641995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:24.641995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 279/550] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:24.647048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.727350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfc3543-6c6d-4ee0-b69b-a0479402f27f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.789476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.790104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.790380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.790655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.806875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a31a93b-b7ec-42ec-8b40-db47e7c03ef9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:24.811371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:24.812805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:24.839346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:24.841061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:24.842657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:24.843721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:24.843721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:24.843721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:24.846894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 272/551] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 359 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:24.851730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:24.873827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:24.874435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:24.874711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:24.874981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:24.875633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:24.875934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:24.877387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:24.889656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:24.902004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 280/552] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:24.908760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.053714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55606f82-bd02-40a2-ab34-80c7952eca86 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.058856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ec38e4-f505-4dbb-bee1-64ea18d7a400 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.097664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.098577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.098996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.099407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.100219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.100528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:25.100965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.101128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.101530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.101943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.103143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f3fae-0126-4c1e-8ddc-9c9ba0983fc5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.110933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.112710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.118666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 273/553] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:25.120195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598518-b17f-4505-8357-75fdbc7f14a1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.120641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598518-b17f-4505-8357-75fdbc7f14a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.121040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43598518-b17f-4505-8357-75fdbc7f14a1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.122654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 274/554] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:25.123998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43598518-b17f-4505-8357-75fdbc7f14a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:25.133708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:25.134859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:25.135802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:25.143059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 281/555] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:25.144376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.186934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.229731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.255427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43598518-b17f-4505-8357-75fdbc7f14a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.266274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8e1d8e-c8e5-4f69-b3a6-d78fafbf8547 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.297170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.297673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.297955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.298225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.302157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.302759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.303036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.303305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.304083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:25.304337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.305488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.305779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53308c-dddb-4786-87c3-b0610953938d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.306924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2f0acfa2-bce4-426f-8a1d-38e72566d3b0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:25.319458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:25.320876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 275/556] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.322284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.323021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.328897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 282/557] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:25.331424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1aaff-3d4d-4bbb-80a9-c7baefba75c4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.331929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1aaff-3d4d-4bbb-80a9-c7baefba75c4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.332448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be1aaff-3d4d-4bbb-80a9-c7baefba75c4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.334197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 283/558] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:25.335746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1aaff-3d4d-4bbb-80a9-c7baefba75c4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.340780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:25.342319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:25.410382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 276/559] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:25.411231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.449916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.459052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be1aaff-3d4d-4bbb-80a9-c7baefba75c4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.486094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.494355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.494957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.495245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.495507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.496232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:25.496534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.498575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510d9953-0dc7-431f-b076-b443ac2e81b9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.516608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 284/560] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:25.517918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c859-4112-46fc-84eb-dcaf17cc58ff None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.518211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c859-4112-46fc-84eb-dcaf17cc58ff None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.518486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be68c859-4112-46fc-84eb-dcaf17cc58ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.530815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfd489e-501c-487b-be8c-5c6c7e31d84e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.537123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-be68c859-4112-46fc-84eb-dcaf17cc58ff None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:25.538470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-be68c859-4112-46fc-84eb-dcaf17cc58ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:25.567254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.567907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.568181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.568560 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.606179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 285/561] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:25.607860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b53c4-f62e-42f3-b317-84c98242298c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.608314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b53c4-f62e-42f3-b317-84c98242298c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.608787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254b53c4-f62e-42f3-b317-84c98242298c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.610221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 286/562] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:25.611167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b53c4-f62e-42f3-b317-84c98242298c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.662066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.663682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783136fa-3405-41ac-b9dc-09cb2b5915ee None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.709590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.731515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254b53c4-f62e-42f3-b317-84c98242298c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.741066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.769167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684096-c797-4846-9009-ae237da90516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.769893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684096-c797-4846-9009-ae237da90516 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.770173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684096-c797-4846-9009-ae237da90516 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.770452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2684096-c797-4846-9009-ae237da90516 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.781402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 277/563] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:25.781648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2684096-c797-4846-9009-ae237da90516 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:25.783057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.783177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2684096-c797-4846-9009-ae237da90516 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:25.783608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.784126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b2684096-c797-4846-9009-ae237da90516 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:25.798556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:25.799787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:25.800888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:25.800888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:25.800888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:25.804093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 287/564] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:25.805144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684096-c797-4846-9009-ae237da90516 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.806105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:25.807439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:25.879882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 278/565] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:25.880953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.910496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2684096-c797-4846-9009-ae237da90516 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:25.946760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:25.948269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:25.948821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:25.949099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:25.952301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:25.962150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:25.968011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:25.968947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 288/566] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:25.970436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:25.999996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.004025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30bc313-7f31-415d-a708-4d52539516ee None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.050211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.050834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.051108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.051377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.064512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.066503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.078882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f8202f-ce6e-4b7d-b9f7-a87ff9cc26cb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:26.081916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.082849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:26.083754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:26.083754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:26.083754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:26.083754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 279/567] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.083754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.123074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.123686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.123964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.124235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.124889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.125215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.126583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.139861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 289/568] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.140604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.192021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7dd5d1-e085-4e7d-8157-c1af50424a63 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.199994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.224730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.225388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.225668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.225936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.236015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:26.241089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.242033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:26.242872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 280/569] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.243566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.246340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a72df8-d5d7-41e3-b459-d4f982575bb7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.257593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.282501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.283176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.283528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.283808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.284483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.284810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.286203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.294741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 290/570] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.295798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.345744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb36e29-cec9-44ed-a322-ec1b14882f6a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.378568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.379160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.379432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.379700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.380356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.380746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.382111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.393086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b580a487-18f7-4765-9ba4-73be756c9617 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.393897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 281/571] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.394674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.409781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.428139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.428768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.429048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.429360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.436080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.437564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:26.448463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.449558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 291/572] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.450825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.467236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.496994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2da067a-c4d8-44d3-a9d9-4d57a7364a02 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.532521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.533200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.533494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.533771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.543597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:26.548623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.549661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 282/573] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.550503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.555331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83dc482-23f6-4e71-8006-424502290260 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.588996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.589629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.589942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.590217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.590900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.591192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.593149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.605806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 292/574] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.605806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.642389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.657008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e1d5d4-03ef-43d9-83c5-ca27cd9e17ad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.686713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.692429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.693044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.693349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.693615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.701487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a58ab7-d6e0-4172-87d5-00a083426b01 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.703559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.704996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:26.718901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.719982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:26.721340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:26.721340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:26.721340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:26.721340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 283/575] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.721340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.736392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.737014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.737317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.737587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.744087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.745549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:26.757176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:26.758238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 293/576] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:26.759135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.820030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16143cb1-21e8-454f-b844-c687e765c87f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.852501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994001bc-f713-4479-a194-64d256495778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.853094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.853234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994001bc-f713-4479-a194-64d256495778 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.853399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994001bc-f713-4479-a194-64d256495778 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.853670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994001bc-f713-4479-a194-64d256495778 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.854841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994001bc-f713-4479-a194-64d256495778 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.855104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994001bc-f713-4479-a194-64d256495778 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.856631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994001bc-f713-4479-a194-64d256495778 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.857676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904b4c3f-1e1d-4743-af52-4840f9474319 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:26.868654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 284/577] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.869477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994001bc-f713-4479-a194-64d256495778 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.897616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:26.898214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:26.898492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:26.898783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:26.899406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:26.899706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:26.901050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:26.908833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 294/578] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:26.909588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:26.914299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:26.971590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994001bc-f713-4479-a194-64d256495778 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.004670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.005311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.005590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.005855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.009525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7bc096-52ed-420a-a69c-2026410c3c6f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.016070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.018202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:27.031672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:27.032747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:27.034002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:27.034002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:27.034002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:27.034002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 285/579] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:27.034002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.047663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.048285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.048549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.048826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.049524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.049830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.051195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.063245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 295/580] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.064008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.084688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.130719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.137109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8366cd-5d74-4e9a-a253-39c0f2cfccfe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.161311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33dddbe9-704f-49d2-aaf5-33019e99d197 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.172673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.173401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.173678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.173955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.174645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.174955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.176388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.192261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 286/581] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.193097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.197727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.198390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.198670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.198947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.213782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=1c86910525fd489eae437f3cedc7443c, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.215214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.229032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 296/582] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:27 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:27.229865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.314314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.315911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c026520-d975-4402-aa7d-dc1ce7eea187 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.351639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ba2e2f-621c-4e43-95f2-368609b1f3d0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.353553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.354255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.354538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.354812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.366477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.368330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:27.389554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:27.390569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:27.391461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:27.391461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:27.391461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:27.391461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 287/583] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:27.391708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.400045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.400655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.400931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.401316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.401871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.402171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.403561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.406780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.417428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 297/584] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.417428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.502850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5df8960-72cb-4c80-8e6a-01634889f6f4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.529994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a6dfd9-6b04-41cb-a334-f127ca4447f8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.538366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.538993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.539268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.539549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.547145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.548581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:27.559505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:27.560750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 288/585] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:27.561751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.563870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.572674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.573556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.574004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.574281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.575073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=ba26775b8b3c49ae878e8ca696c3cda5) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.575383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.577598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.585339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 298/586] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/role_assignments?user.id=ba26775b8b3c49ae878e8ca696c3cda5&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.586177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.661220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.705610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed50688-ba39-47b2-bf83-848b8354bb6c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.712937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3977de0-0b4e-425c-a9d3-3fc7ded5d744 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.749361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.750304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.750760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.751357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.757712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.758327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.758610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.758885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.759538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.759842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.761596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.761708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.764007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.780455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 289/587] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.780455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:27.784017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:27.785105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:27.786239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:27.788123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 299/588] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/users/neutron => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:27.789125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.859146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.913414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e485c534-8bc0-4bab-9541-2989c1fcaa6c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.917585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beeefe68-dcf3-4913-a459-a392b0dc9023 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:27.946743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:27.958492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.959190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.959460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:27.959653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.960024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.960537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:27.960964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:27.961078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:27.961448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.961645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:27.963292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.970835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:27.972893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:27.988057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 290/589] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:27.988057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:27.991893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:27.993002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:27.994090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:28.001747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 300/590] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:28.002371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.101633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2638c7-bc7c-469d-a52c-132d204443d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.115065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bd621-a9fd-4b62-8b33-dad2f9888581 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.129219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.141101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.142018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.142585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.143230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.144188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:28.144696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.146579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.150728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.151368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.151650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.151927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.163542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.165001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.166815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 291/591] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 04:57:27 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:28.167923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:28.185030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:28.186210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:28.187109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:28.187109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.187109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:28.193663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 301/592] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:28.194192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.285650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.298690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54992c19-4da6-48b2-ae82-bb75cfa287a8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.322378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50393a90-183d-42c1-9864-22d3a29931cd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.345071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.345712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.345994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.346292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.346994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:28.347301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.348712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.370934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 292/593] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:28.370934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.374228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.374869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.375148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.375424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.393563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.395997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:28.414243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:28.415244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:28.416133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:28.416133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.416133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:28.418579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 302/594] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:28.420597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.446621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.483374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752b5e7-4eaa-47e9-9326-c23f1af59235 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.484846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.521216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.522502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.522977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.523391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.524188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:28.524632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.526169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.538207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 293/595] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:28.539220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.556986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98e3e9-4fc7-4560-89f8-167d6d27c3f0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.599377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.600103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.600443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.600778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.613010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.614675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:28.630111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:28.631298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:28.632374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:28.632374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:28.632374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:28.637528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 303/596] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:28.638764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.649475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80d82f-fbea-4801-8358-b6c6cc8a62d4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.687038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.687649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.687933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.688329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.689252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:28.689563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.690924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.705169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 294/597] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:28.706169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.713898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.736589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.750243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614cad63-f183-47b6-82ce-8e4810342dc5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.786711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.787438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.788701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.789045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.797594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.799452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:28.815915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:28.816996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:28.818131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:28.821254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 304/598] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:28.822210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.829673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6915b2b1-0e9e-4702-a33b-61061b1d3026 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.871002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.871764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.872271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.872620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.873711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:28.874011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.875475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:28.892594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 295/599] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:28.893627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:28.931098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e15a7b-382e-40a9-8cc4-deb0a44cadb3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:28.972920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.980917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:28.981840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:28.982310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:28.982761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:28.983888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:28.990605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:28.993003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.004229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1272e22d-eb1b-4103-a092-d3219c9f690c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:29.005533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:29.006431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:29.007316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:29.009784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 305/600] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:29.010847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.042365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.042967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.043314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.043654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.044974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:29.045492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.047100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.065106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 296/601] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:29.066213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.120277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64907c3-4be5-4388-9cfb-abd620c87405 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.161907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.162917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.163957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.164418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.175667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.176770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d46c4ce-29f6-47d5-bcdc-ac0170c01635 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.177646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:29.193512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:29.194487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:29.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:29.199576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 306/602] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:29.200695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.225873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.227166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.227601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.228024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.228976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:29.229537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.231279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.245205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 297/603] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:29.245983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.252705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:29.257249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:29.313603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9106f6-0079-46be-a465-4bc2d0e3b2eb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.348830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.349517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.349800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.350075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/b1e3deabee4f46cb9e0c15f94e5ab23d/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.359255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406d8cdf-d581-45a5-9862-63a494bba88e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.365583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=b1e3deabee4f46cb9e0c15f94e5ab23d, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.367030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dad8df3-ffe8-4a90-8659-06f5040bcf34 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.380881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 307/604] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:29 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/b1e3deabee4f46cb9e0c15f94e5ab23d/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:29.383223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ba69-e241-4057-b3db-57994b059e9b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.383712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ba69-e241-4057-b3db-57994b059e9b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.384465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91ba69-e241-4057-b3db-57994b059e9b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.387201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 308/605] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:29 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:29.389259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ba69-e241-4057-b3db-57994b059e9b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.397991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.398813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.399153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.399495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.400318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:29.400691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.402518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dec656a-6fca-41c4-b0d1-7c4e43f8a016 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.424144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 298/606] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:29.425880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.426581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.426581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.453588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:29.455999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:29.512879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:29.517806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91ba69-e241-4057-b3db-57994b059e9b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.536500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:29.554380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 299/607] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:29.555491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:29.566871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.567545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.567893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.568238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/76b44e52d3524340925fd7d7e2273763/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.589209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=76b44e52d3524340925fd7d7e2273763, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.589209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c750a9-f46f-4be1-a051-c430f81bc09f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.605158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 309/608] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:29 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/76b44e52d3524340925fd7d7e2273763/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:29.606538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853e6c-50df-427a-b944-f3b9375ba3a4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.606854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853e6c-50df-427a-b944-f3b9375ba3a4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.607182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25853e6c-50df-427a-b944-f3b9375ba3a4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.608872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 310/609] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:29.622056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.623702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.624003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.649553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:29.650906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:29.712183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666aa76b-0250-48c2-90f9-da7c999ddc55 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:29.789173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:29.789873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:29.790154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:29.790429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fec5602226564e6b95baf1ab9824ff0f/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:29.800926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 311/610] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:29.809423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=fec5602226564e6b95baf1ab9824ff0f, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:29.811698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:29.830655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 300/611] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:29 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fec5602226564e6b95baf1ab9824ff0f/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:29.891859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.011873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.035388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf3a95b-08a9-4c36-acee-77e0760e1cda None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.074534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.076260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.077026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.077537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.088686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:30.097018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:30.098916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:30.100685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:30.106732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 312/612] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:30.112583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.131980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.191605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.271971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86996ed4-3c1b-4ec7-9f2b-ba12ff4a8c8f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.278114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4297ff-e240-4194-a5ae-143e3ed20f01 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.313774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.314410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.314690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.314964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.325560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.329737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:30.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:30.336047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:30.337933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 313/613] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:30.346365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.348837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.349474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.349752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.350022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.350689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:30.350989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:30.352369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:30.373013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 301/614] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:30.378376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.470593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfc8041-b1f9-4fe6-b011-7588addc4fd1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.506461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.507072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.507351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.507625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.508297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:30.508599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:30.510223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:30.520810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405309bd-48d5-4b4f-9c10-c03c38702c2b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.523379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.524167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 314/615] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:30.525557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.571458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.572733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.573271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.573743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.593811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:30.595072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.596841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:30.620804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:30.621868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:30.622812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:30.622812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:30.622812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:30.622812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 302/616] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:30.629167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.631352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54a5b13-4898-4f49-ab21-c107e290a9b8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.667374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.668165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.668543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.668930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.680319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:30.681930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:30.697322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:30.698504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:30.699594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:30.699594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:30.699594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:30.706761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 315/617] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:30.708133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.811275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b7f3c2-5091-46a9-96cf-f9abc11857e5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.825331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:30.846518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:30.847333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:30.847661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:30.848039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:30.848889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:30.849359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:30.850828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:30.868443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 316/618] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:30.869776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:30.914652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e322ffbd-80eb-43ad-bdf1-12d8d8c168ee None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:30.972217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc5837-070d-4443-8f02-57ccda627eaf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.008821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.009556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.009834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.010108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.010757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:31.011058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.012434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.031906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.032561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.032842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.033116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.043448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 303/619] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 415 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:31.045166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.046643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.049160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:31.072099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:31.073323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:31.074303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:31.077289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 317/620] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:31.080124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.093531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.134437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.206876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38e6da6-4827-4630-9c7c-36d2360ba19b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.244299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.244928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.245221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.245595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.246343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:31.246648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.248137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.269411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829c87dd-ed5b-48f7-9ce4-d2f7305968a0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.270998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 318/621] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:31.273122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.329569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.330208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.330483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.330748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.341572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.343014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:31.370492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:31.371492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:31.373041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 304/622] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:31.374568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.378122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.381632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3afb62-987d-4884-bdcb-24e4297bf999 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.420236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.420799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.421083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.421604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.441697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.443149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:31.473511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:31.475045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:31.475952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:31.475952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:31.475952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:31.484740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 319/623] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:31.488780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.540301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.587007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948c8b89-e6e4-4763-96ee-c7ca55987c0f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.651994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.652606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.653043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.653349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.654875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:31.655183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.656614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.676748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 305/624] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:31.681842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.706716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3c9129-8a78-4fec-8bf5-a30d6309198b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.748482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.749275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.749658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.750030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.750775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:31.751193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.752646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81dae06d-d60f-413f-a66c-7f9b389a4fc0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.767822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 320/625] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:31.769941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb91e0-1776-4cfd-a381-7b89fc026564 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.770228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb91e0-1776-4cfd-a381-7b89fc026564 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.770504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb91e0-1776-4cfd-a381-7b89fc026564 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.771982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 321/626] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:31.775067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb91e0-1776-4cfd-a381-7b89fc026564 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:31.780642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.819984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85404b94-7cb9-4ef1-a362-d3d6f89e3f61 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.864340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.865417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.865572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.865931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.868867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:31.908338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb91e0-1776-4cfd-a381-7b89fc026564 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:31.945988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:31.946773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.947530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.947530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:31.950104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.952636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545ec40d-b194-40f7-bb49-393381a864a4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.956206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:31.957883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3e1f893a-42fb-490e-b709-78524e9cfdd2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:31.970676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:31.971899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:31.972993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:31.979101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 322/627] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:31.980445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:31.980866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:31.981150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.003495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:32.005772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:32.064252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 306/628] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:32.066333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da16b1-358a-4eea-85ff-106bd9f779ea None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.067181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da16b1-358a-4eea-85ff-106bd9f779ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.067990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da16b1-358a-4eea-85ff-106bd9f779ea None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.069204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.073326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 307/629] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:32 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:32.074763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da16b1-358a-4eea-85ff-106bd9f779ea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.084729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 323/630] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:32.085595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.129424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.196168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ded629e-c389-45ef-b1e3-021559700a7b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.218883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da16b1-358a-4eea-85ff-106bd9f779ea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.234858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.235494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.235772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.236041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.246813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.248858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.257692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.258309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.258591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.258867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.259590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:32.259890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.261336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ac2d82-dc1e-4736-8164-2634fb36888a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-894f242b-2f11-4fb0-a95f-ae6527355be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:32.267931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:32.268857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:32.269772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:32.269772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:32.269772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:32.270759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 324/631] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:32.271572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad338-ed2d-4388-bece-e7272027084c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.271855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad338-ed2d-4388-bece-e7272027084c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.272129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549ad338-ed2d-4388-bece-e7272027084c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 308/632] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7c57-cce1-4a31-a43f-8f08f09cba3f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7c57-cce1-4a31-a43f-8f08f09cba3f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffe7c57-cce1-4a31-a43f-8f08f09cba3f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 309/633] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:32.284641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe7c57-cce1-4a31-a43f-8f08f09cba3f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.296609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-549ad338-ed2d-4388-bece-e7272027084c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:32.298204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-549ad338-ed2d-4388-bece-e7272027084c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:32.345026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.381213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 325/634] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:32.381213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ad338-ed2d-4388-bece-e7272027084c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.398067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.408845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffe7c57-cce1-4a31-a43f-8f08f09cba3f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.443000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.443606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.443891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.444164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.444803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:32.445105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.446548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436bd76a-8eae-49e2-85b7-e25a439ea35b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.463756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 310/635] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:32.463756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.463756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.463756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.479774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:32.480988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:32.487692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549ad338-ed2d-4388-bece-e7272027084c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.525251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.525915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.526194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.526466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/ba26775b8b3c49ae878e8ca696c3cda5/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.543337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=ba26775b8b3c49ae878e8ca696c3cda5, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.545572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.548797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 311/636] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:32.549724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.564994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 326/637] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:32 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/ba26775b8b3c49ae878e8ca696c3cda5/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:32.566293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.609380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.672126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744f6751-17d9-4b51-accc-5447fd417159 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.702588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea28eaa-90da-4c65-b431-46b1f8320b87 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.705548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.711152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.712105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.712480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.712845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.726240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:32.732168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:32.733492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:32.734539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:32.736847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 312/638] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:32.737279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.742620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.743272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.743553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.745153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.751826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.754179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:32.766101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:32.767057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:32.768087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 327/639] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:32.768831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.869700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.870886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f3f2f-ddaa-419a-89ba-9593737f3347 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.891303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe857eb-3ec6-4d8d-a1dc-b888413b8035 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:32.910016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.910738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.911083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.911421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.921780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:32.926727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:32.927814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 313/640] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:32.933523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:32.935848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:32.939203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:32.939901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:32.940282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:32.940615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:32.941729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:32.941729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:32.943849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:32.953247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 328/641] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:32.958200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.043183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e48cd1-6654-43bd-8950-05956c3b7c12 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.064148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0c0c60-dcab-42fc-8944-2269bf43bed7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.081614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.082220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.082497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.082767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.083556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.083750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.085169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.101914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 314/642] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.102641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.104298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.104932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.105257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.105518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.116511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:33.121829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:33.123387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:33.124246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 329/643] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:33.125812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.135854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.180956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.223282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7fc09b-0fb2-41e3-828c-62f4e765a050 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.242852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4f9a0b-112f-4709-bbf4-66f498d6b8da None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.258457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.259058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.259334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.259602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.260255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.260581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.261953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.270908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 315/644] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.274354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.281605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.282361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.282708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.283009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.295881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.297372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:33.312739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:33.313750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:33.314807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:33.314807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.314807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:33.314807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 330/645] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:33.314807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.380840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.387574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414bf5ba-1ae1-44a5-b2f1-442b3f94bdd6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.414166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.424173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.424780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.425064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.425374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.426100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.426409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.427823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.430294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfe282-f555-4757-92e2-9b8d6233956e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.434407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 316/646] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.435483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.483053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.484111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.484599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.485196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.486063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.486552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.488281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.504021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 331/647] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.505436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.551885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc5e58-41a5-4586-b173-2d7a4cbe8a04 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.591845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.592557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.592763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.593053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.606222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.609322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:33.630004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:33.631017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:33.631923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:33.631923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.631923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:33.631923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 317/648] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:33.633474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.652166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca369998-3756-4474-a9d7-c9617ce146c8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.678881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.687870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.697491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.698117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.698407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.698675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.699336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.699640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.701667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.715092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 332/649] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.716566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.772395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1b8b13-dd9a-47fb-9ffb-507c40bf02d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.816713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.817813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.818688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.819144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.833635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.835315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.846316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eae39e-e462-498a-9380-1382e0a8fd97 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:33.859483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:33.860659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:33.861828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:33.861828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:33.861828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:33.867636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 318/650] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:33.867636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.893083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:33.894179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:33.894605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:33.895024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:33.895817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:33.896380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:33.898088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:33.911978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 333/651] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:33.913303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:33.963525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.966069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:33.975192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c4796-844d-4916-a116-a8d478fd3e54 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.016824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.017724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.018130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.018539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.027839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.029452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfbffce-e5d2-4607-ac13-8093a03d5d50 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.029579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:34.041921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:34.042925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:34.044358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 319/652] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:34.046083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.069531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.070481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.070908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.071323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.072208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:34.072655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.074377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.093305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 334/653] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:34.094181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.159302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec104b5-8a08-41ca-87e7-3fa4c23273f5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.205658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.206288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.206565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.206835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.207273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60bf0ac-2d60-479a-855b-b83d48391bdf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.209380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.218759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.220799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:34.237433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:34.238547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 01 04:57:34.239524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:34.241980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 320/654] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:34.243094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.257383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.258224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.258570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.258871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.260420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:34.260838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.263891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.266871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.294145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 335/655] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:34.294942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.367630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca82770-b202-4723-8503-f3dd47d2b4b4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.404217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.405270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.405768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.406246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.414434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.416115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:34.427679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:34.428727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:57:34.429791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:34.430399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ebe653-0195-41c8-b895-e33dc09827f4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.436749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 321/656] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:34.437904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.476307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.476922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.477224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.477557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.478354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:34.478658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.480124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.505963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 336/657] 10.222.0.43 () {56 vars in 1139 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:34.507231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.522360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.533624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.551341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8253f906-27cd-4763-b104-0a97733ea12d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.598268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.598948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.599227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.599502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.633689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a94c4c-1021-4c00-9d13-d46b99093304 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.670396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.671121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.671401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.671671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.672405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:34.672712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.674179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.674785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.676461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64033b5-58dd-4675-b471-1eda17640bdd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.691137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 337/658] 10.222.0.43 () {56 vars in 1137 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:34.691956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.768876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.774273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:34.799328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 322/659] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:34.799488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42b2f-dd5d-43d7-a1b6-3e2fd4a8dace None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.800987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2d82-3834-4731-bc31-a3f2cbb45206 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.801403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2d82-3834-4731-bc31-a3f2cbb45206 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.801693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05c2d82-3834-4731-bc31-a3f2cbb45206 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.803203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 323/660] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:34.804011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2d82-3834-4731-bc31-a3f2cbb45206 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:34.844745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.845386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.845669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.845946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:34.914353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:34.916087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:34.918229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05c2d82-3834-4731-bc31-a3f2cbb45206 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:34.957399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:34.958012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:34.958293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:34.958575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.003736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.004639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.029846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 338/661] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:35.030612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.037018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.038520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159615f4-6167-480f-8032-bdb28fd5e622 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.146358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 324/662] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:35.147144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ba297b-33c5-45c0-9057-5fadd18d3628 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.148175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.148658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.148934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.169552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:35.170762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:35.185792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.186431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.186917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.187046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.197371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.198811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:35.216003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.217818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:35.218794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:35.218794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.218794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:35.218794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 339/663] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.218794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.248667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.249692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 325/664] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:35.258467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.263111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.333096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27febef4-25ef-4dd0-817c-76a75501b5ff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.370136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.370906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.371142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.371420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.384225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.385729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.394862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b58f82-a9e8-43df-9cd3-c0bf34fb5adc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:35.404368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.405747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:35.406682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:35.406682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.406682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:35.406682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 340/665] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.406924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.447103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.448154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.448703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.449218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.461094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.462988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:35.480107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.481084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:35.482523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:35.482523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:35.482523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:35.489220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 326/666] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.490444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.492522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.514425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b41d8-519f-441c-94e0-0e9fad9b3af1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.552112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.552727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.553022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.553329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.553980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:35.554287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.555661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.557337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.568975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 341/667] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:35.569827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.602629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc10259-e537-47ad-8188-e164de85d347 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.636093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.636683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.636960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.637264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.638528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:35.638823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.640176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.652018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 327/668] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:35.652798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.676588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b413e77-65ed-4b22-aa4c-238863b4f557 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.709868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.710468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.710744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.711021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.711708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:35.712012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.713402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9b4097-5c46-47c8-ae3b-36d0fe902ed0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.722449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.725794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 342/669] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:35.727286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de017b-0d28-4839-9a56-c7deec38ca57 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.727723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de017b-0d28-4839-9a56-c7deec38ca57 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.728220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7de017b-0d28-4839-9a56-c7deec38ca57 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.729596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 343/670] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:35.730347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de017b-0d28-4839-9a56-c7deec38ca57 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.753469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972946-69cb-45b5-a03b-e9605c9989de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.770091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.787509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.788134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.788412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.788687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.799016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:35.803778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.804878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 328/671] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.805788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.833544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7de017b-0d28-4839-9a56-c7deec38ca57 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.866483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.867111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.867482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.867770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.875148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.876615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:35.888385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:35.890475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:35.893319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 344/672] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.894332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:35.901655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a052721e-6213-4864-88cd-0e22a7009d82 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:35.935533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:35.936222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.936485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.936757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.946052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:35.947509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:35.952198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4172c284-f7f1-48ee-a462-df3002584efa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:35.959647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:35.960588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:35.961521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 329/673] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:35.962238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:35.962444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:35.962746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:35.980429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:35.981716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:35.997311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a40ac6-9a7b-4028-939a-5dd1c7ca9207 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.009674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.030865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.031500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.031781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.032056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.038642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.040080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.047878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 330/674] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:36.048703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:36.051206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:36.052107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:36.053045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 345/675] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:36.054805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.150693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99cd70cc-857d-49e8-9737-86849a428b56 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.187941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.188503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.188777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.189051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.189746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.190054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.190572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604c6204-fbb5-47ec-8f27-92c132c46e83 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.191704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.204743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 331/676] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.204743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.218680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.233290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.233763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.234372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.234650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.234928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.235725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.236097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.237542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.255175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 346/677] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.255175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.320602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cf9390-68bc-485c-a61e-6613ec3e3688 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.352681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1e901-be5b-44b4-9975-dd452055fcba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.354049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.354658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.354936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.355210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.355896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.356208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.358251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.370037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 332/678] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.370827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.387851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.388591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.388872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.389142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.389859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.390163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.391578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.402882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 347/679] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.404285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.445758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.458532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.471936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a14d90-442b-4eff-b159-8e3155f69fbb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.503377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68180ca-335c-48f5-95db-6df890de0656 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.505072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.505725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.506008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.506281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.518621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.520077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:36.537419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:36.538478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:36.539365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:36.539365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:36.539365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:36.539535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.539634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 333/680] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:36.539717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.539717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.539842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.539910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.540302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=b1e3deabee4f46cb9e0c15f94e5ab23d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.540513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.541940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.548917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 348/681] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/role_assignments?user.id=b1e3deabee4f46cb9e0c15f94e5ab23d&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.548917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.662178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47661613-e88f-4f4f-b40b-e9841ea43e49 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.664856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.667393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5864be9e-c3e0-4e0b-8fed-c3a5bdf070d6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.704593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.705137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.705448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.705724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.706458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=76b44e52d3524340925fd7d7e2273763) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.706769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.706999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.709470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.709470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.709760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.709856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.714718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 349/682] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/role_assignments?user.id=76b44e52d3524340925fd7d7e2273763&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.715654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.719615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:36.725562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:36.726556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 334/683] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:36.727421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.730226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:36.864790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cbc826-7cdf-4670-9c59-6d50ca8d5066 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.865438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c71c46-de71-4e33-b858-ff223e20f9e1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:36.905744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.906602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:36.906772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.906938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.907183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.907455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:36.907797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:36.907906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.908121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.908227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:36.908998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fec5602226564e6b95baf1ab9824ff0f) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:36.911689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:36.911831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.911934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:36.919462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 350/684] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/role_assignments?user.id=fec5602226564e6b95baf1ab9824ff0f&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.921214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.933719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 335/685] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:36.940347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:36.978119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.013916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.060415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2235078a-4d43-41a5-9564-eac1821f5466 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.066055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788cfc96-a69b-469e-8df4-2078d5bb0d8f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.104307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.104934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.105219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.105501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.108790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.109648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.110079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.110500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.111331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:37.111783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.113022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.113500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.115326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.124207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 351/686] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:37.130401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:37.131590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:37.132762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 336/687] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:37.133503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.136791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.239510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.247877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2729210-9ec8-4fd0-8c05-507d2dcdcaa9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.255697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834a13db-8bfb-4301-8898-c14908b6f6b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.276778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.286512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.287376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.287802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.288247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.294913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.295744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.296119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.296484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.297353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:37.297755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.299276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.303651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.305286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.319242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 337/688] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:37.321164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:37.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:37.323032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:37.323032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:37.323032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:37.329229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.329414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 352/689] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:37.332876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.466718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c263c0-7ddf-4451-8231-f5b74a2244e2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.487452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d0d665-1035-406e-ac83-20869ec5c029 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.537511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.538385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.538810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.539239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.556466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.557356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.557802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.558231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.559036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:37.560031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.561747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.599565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 353/690] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:37.605940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.609559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.626773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.641257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.641257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.782437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 338/691] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:37.787753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.806153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f686a4a4-4d5a-45f4-a158-beddfba2afca None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:37.873675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:37.875228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:37.876218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:37.876739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:37.889210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:37.893243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:37.906784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:37.908045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:37.909256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:37.910806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 354/692] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:37.920293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:37.924356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:37.995080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33aeb36c-5a79-4bf3-b6d8-1e23e17a745d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.008847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:38.049776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f97971-35fb-4304-a98e-7c0eb08b76c7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.087704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.088315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.088598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.088873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.089721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:38.090029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.091532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.093883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.094534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.094819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.095100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.115571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 355/693] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:38.116946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.134026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.135489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:38.171112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:38.172144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:38.173025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:38.173025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:38.173025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:38.173025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 339/694] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:38.177974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.235033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e9b06-89c7-4448-9277-850a9d9d952d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.261788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:38.282083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.282709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.282963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.283238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.354098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dea886a-f297-4da1-b4e2-b2a45867df59 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.392886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.394009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.394299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.394578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.395234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:38.401228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.401228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.411984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:38.418650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 340/695] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:38.422763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.447904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.451499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.595647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eec5ea5-4204-418b-89b6-0cda206ac311 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.636090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.636719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.636999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.637400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.645800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.647839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.661702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 356/696] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 545 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:38.662196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:38.663047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:38.663968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 341/697] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:38.669521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.670861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.731309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:38.737976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:38.788863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cfbe2b-6c97-46bc-96fe-137d9e7632df None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.826384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.827642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.828082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.828498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.840256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.842901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9b6af7f2-947a-4ead-96d3-75ba214b6335 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:38.870787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:38.872386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:38.873899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:38.873899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:38.873899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:38.873899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 342/698] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:38.874371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d179-cf95-4eeb-acc0-8190453a8499 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.874442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d179-cf95-4eeb-acc0-8190453a8499 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.874675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a10d179-cf95-4eeb-acc0-8190453a8499 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.876143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 343/699] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:38.882018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.882590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.883068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.902924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:38.904703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:38.906038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a531496d-957a-4e74-ac37-8ac8e38c4022 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:38.954785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:38.955692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:38.956225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:38.956695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:38.957681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:38.958292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:38.960091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:38.974577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 357/700] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:38.975865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:38.993216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 344/701] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:38.993216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.021497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.100984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e9e34e-b748-4ce4-a0dd-b0f7203de363 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.130027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.146696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.147563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.147898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.148176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.148826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57edcb2-e455-4aa7-a767-8fc867a71e21 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.148937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=ba26775b8b3c49ae878e8ca696c3cda5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:39.149205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.151893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc38195-652c-4d41-803c-9cfef9408c09 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.159419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 345/702] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/role_assignments?user.id=ba26775b8b3c49ae878e8ca696c3cda5&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:39.161012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238de6-f6c7-42d8-9a1e-32c0a3b0e2dd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.161320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238de6-f6c7-42d8-9a1e-32c0a3b0e2dd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.161590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45238de6-f6c7-42d8-9a1e-32c0a3b0e2dd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.162962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 346/703] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:39.170410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.170742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.170957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.195070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:39.196260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:39.197077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.198029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.198525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.198989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.200392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:39.200910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.202502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.216223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 358/704] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:39.226421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.286536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 347/705] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:39.360551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad80cae-7377-4b40-aa9d-3e4af4f4fb54 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.383236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.400288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.400982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.401337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.401617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.410845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.412346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.418322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:39.425806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:39.426752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:39.427650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 359/706] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:39.432530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.436379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.515142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74487b4a-0e72-47f5-8c73-d9d46b43916f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.555031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b163599-f4bc-4a78-aaa6-8a64bb050044 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.558827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.559494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.559775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.560039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.572122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.574472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bea6cef2-1495-4dd0-a3f4-8b65b1b2c96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:39.595554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:39.596626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 348/707] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b17b-2f32-467c-8c29-0c47267e5d73 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.597570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b17b-2f32-467c-8c29-0c47267e5d73 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.597958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60b17b-2f32-467c-8c29-0c47267e5d73 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.603478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 349/708] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:39.604610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b17b-2f32-467c-8c29-0c47267e5d73 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.607645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.608266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.608543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.608812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.609547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:39.609851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.611277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.624572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 360/709] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:39.625451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.693762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.701876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.719134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60b17b-2f32-467c-8c29-0c47267e5d73 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.743916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45494ae5-61da-40aa-9fc3-5a6fd1bc0b07 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.758226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.759005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.759128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.759394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.760041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:39.760342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.761804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffbdfa3-55d0-4270-a953-d470bcacbb79 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.773820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 350/710] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:39.782108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.782556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.782832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.783102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.783771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.784049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.784314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] PATH_INFO: `/v3/services/network` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.784893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:39.786280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:39.798848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:39.799896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:39.800811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 361/711] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/services/network => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:39.801674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.806690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:39.807899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:39.885659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 351/712] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:39.885659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:39.950693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a411d-0380-4ec5-9843-df91128bc003 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.977600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.986492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:39.996945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:39.997664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:39.997948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:39.998221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:39.998592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0341345d-aba4-43fc-9893-e86b77452f18 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:39.999021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:39.999249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.000954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.008369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 362/713] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:39 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:40.009219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:40.039898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.040923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.048222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.048890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.049870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.051686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.082641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 352/714] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:57:39 2022] POST /identity/v3/users => generated 254 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:40.167975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2977449-3bba-49ed-a8fd-d8de5810ab1e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:40.203490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:40.221683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.222321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.222601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.222876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.223529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:40.223835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.227097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.239116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 363/715] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:40.250957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:40.332406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:40.378455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de24d4d8-54cf-4716-9123-c3be15a8b9b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:40.379821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99825e97-4848-4915-b4c8-7a7f84cfa317 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:40.413495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:40.427246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.427885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.428165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.428440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.429025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.429861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.430422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.430999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.431383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.431759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.432501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:40.433424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.436575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.449216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 364/716] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:40.449424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:40.451217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:40.452095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:40.453550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 353/717] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 04:57:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:40.458191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:40.580709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1bca92-c1d4-42fe-84fa-5f2912c47d87 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:40.605607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:40.622923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.623536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.623813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.624084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.624721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:40.625080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.626415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6295dd-5aa7-4e04-9c78-c43b90933dc2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.631656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 365/718] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:40 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:40.637949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:40.756557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6c2798-1494-43bd-82ad-896c3f4a8649 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:40.799121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:40.799754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:40.800041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:40.800496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:40.801271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:40.801583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:40.803656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20359689-bb9f-400a-b51c-d0c98235cbab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:40.810854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 354/719] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:41.596604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff5e2-2558-47d4-9494-01477f7b9d2c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:41.597113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff5e2-2558-47d4-9494-01477f7b9d2c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:41.597223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cff5e2-2558-47d4-9494-01477f7b9d2c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:41.598802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 366/720] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:41.603730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:41.604169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:41.604360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:41.641309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:41.642510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:41.708555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:41.733782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 355/721] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:42.095447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cff5e2-2558-47d4-9494-01477f7b9d2c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:42.231504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cff5e2-2558-47d4-9494-01477f7b9d2c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:42.274057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:42.274695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.274969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.275236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.298706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:42.304096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:42.305037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:42.306055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 367/722] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:42.311502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:42.468001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67625e-88bc-49a0-a5d8-41f6dcc62c93 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:42.503224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:42.503727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.504003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.504273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.504940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:42.505277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:42.506637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6983d0-50e4-4b47-a730-fbd4b5f8c771 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:42.515869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 356/723] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:42.522518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:42.536567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468f5a-4e78-4e91-84fa-a6913cec3570 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.536866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468f5a-4e78-4e91-84fa-a6913cec3570 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.537118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d468f5a-4e78-4e91-84fa-a6913cec3570 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.540216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 357/724] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:42.544459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.544741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.545072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.581536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:42.584982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:42.610942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:42.658472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:42.719941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 358/725] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:42.720318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed584150-40be-4a36-a1d1-868d3652cf99 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:42.766373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:42.766928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.767205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.767476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.780813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:42.784934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5a160640-8976-4294-afcd-a3745749c656 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:42.803789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:42.804840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:42.806396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:42.806396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:42.806396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:42.809519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 368/726] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:42.811250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:42.836580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57da7-4cb4-4d19-b495-d4de45ebbe74 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.836872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57da7-4cb4-4d19-b495-d4de45ebbe74 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.837125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e57da7-4cb4-4d19-b495-d4de45ebbe74 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.838465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 369/727] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:42.846061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf941c2-5f2e-44cf-89b5-fd4eaf2d11ec None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.846336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf941c2-5f2e-44cf-89b5-fd4eaf2d11ec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.846606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf941c2-5f2e-44cf-89b5-fd4eaf2d11ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.877859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8cf941c2-5f2e-44cf-89b5-fd4eaf2d11ec None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:42.879053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8cf941c2-5f2e-44cf-89b5-fd4eaf2d11ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:42.955076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 370/728] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:42.976454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9a8f1-f61d-445d-b176-eaa6cd80bd8e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:42.983423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3eec1-655d-44ac-9041-dcbe3f3ca314 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.983715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3eec1-655d-44ac-9041-dcbe3f3ca314 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.983989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3eec1-655d-44ac-9041-dcbe3f3ca314 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:42.985566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 371/729] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:42.990503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:42.990783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:42.991053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.025487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:43.026594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:43.031114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.031724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.032008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.032271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.032919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:43.033240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.034594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.057528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 359/730] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:43.066891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.070192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.136228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.153230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 372/731] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 01 04:57:43.154635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.221042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d665f23-2906-47eb-bc39-b08700765636 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.264251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.265410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.265974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.266485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.272400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a195b89-45c6-491a-931f-433755b44cd7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.274790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.276583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:43.289093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:43.290104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:43.291476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:43.294575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 360/732] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:43.300666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.323496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.324551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.325093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.325593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.344055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:43.349229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:43.350176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:43.351027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:43.357957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 373/733] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:43.359201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.384670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.409470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.417703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c8623b-ae09-4421-af0f-e031edadb467 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.456426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.457324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.457743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.458247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.459128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:43.459684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.461276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.481001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 361/734] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:43.482404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.484332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fc4061-4e3e-43e7-b0d3-d50149656ca4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.525405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.526377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.526931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.527411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.539593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:43.545993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:43.547098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:43.548116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:43.555479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 374/735] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:43.556782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.597649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea1e47-cf52-4f31-9371-41730ab7072f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.630994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.631596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.631877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.632153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.632814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:43.633115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.634500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.634654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.643081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 362/736] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:43.643935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.658817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.663018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b8f01-7e4c-47d7-942c-1ce2e11fa44b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.696965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.697603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.697888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.698163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.739894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e2dcc1-77bb-4ff8-8bdd-998a292fec8c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.765917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.767366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1a368-9afe-4daa-bf4a-9dc8ca96ac19 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.772788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.773414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.773749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.774023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.774659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.775989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.791966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 363/737] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:57:43 2022] POST /identity/v3/services => generated 240 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:43.792512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.870459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.884525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:43.900162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 375/738] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 01 04:57:43.901939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d70a-4016-4ef7-9f24-3ef202ade13b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.902436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d70a-4016-4ef7-9f24-3ef202ade13b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.903475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce8d70a-4016-4ef7-9f24-3ef202ade13b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.905172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 376/739] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:43.906261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8d70a-4016-4ef7-9f24-3ef202ade13b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:43.936879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa5545-a863-4d4d-b7a6-f1c814318926 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:43.982656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:43.983280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:43.984266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:43.984266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:43.984493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:43.984795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:43.986230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:43.994421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 364/740] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:43.995457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.037917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce8d70a-4016-4ef7-9f24-3ef202ade13b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.072504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.073167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.073468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.073738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.084852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.086326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8307565a-f872-4854-9813-3420e29402f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:44.101246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:44.102238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:44.103157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:44.103157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.103157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:44.103157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 377/741] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:44.103808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.103808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.104048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.112892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf21994-c4b8-4dcb-abd5-aa47070f418e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.122717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:44.123894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:44.144717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.148206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.151447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.152092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.152377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.152822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.165168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.166636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:44.183497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:44.185274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:44.186330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:44.186330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.186330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:44.186330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 365/742] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:44.190169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.198454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 378/743] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:44 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 01 04:57:44.199437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.313377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0cf1f98-478b-4828-a5f2-eccb31e2dfff None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.322767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b932a814-b496-40ea-9ee9-1441985ab490 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.349781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.350395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.350705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.350980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.351622 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:44.351926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.354232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.372864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.373777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.374201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.374702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.375368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 379/744] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:44.376249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.389461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.391125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.404084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:44.413425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:44.414581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:44.415568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:44.415568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:44.415568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:44.417947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 366/745] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:44.419193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.465880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.507179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87e0643-ff2e-43df-8af7-93b9eb2d1fa4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.546124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.546728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.547011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.547293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.547936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:44.548240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.548733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4780b161-c015-40f9-a209-08d2dffec134 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.549651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.561926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 380/746] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:44.562567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.593453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.593999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.594273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.594547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.601666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.603100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:44.614932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:44.615875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:44.616868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 367/747] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:44.618031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.649470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.673571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b603a-de1b-4618-9ba9-6e0d7358580a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.711980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.712584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.712865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.713138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.713817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:44.714120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.716243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.718335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.728697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df28e0df-ca7a-4aab-8ab5-03b4e01fd3c6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.728835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 381/748] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:44.729625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.766966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.767680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.768016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.768353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.769001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.770387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.789275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 368/749] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:57:44 2022] POST /identity/v3/services => generated 251 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:44.789275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.859961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a408ee2-8f76-46ac-99f8-ad69d4fa6614 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.915742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.916600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.916884 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.917157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.920750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:44.928172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.930234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:44.931759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bf57be-e99e-4f18-bb22-db253f83e335 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:44.945754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:44.946905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:44.948015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:44.949040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 382/750] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:44.950375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:44.983902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:44.984544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:44.984825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:44.985099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:44.985885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:44.986194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:44.987651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.007757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 369/751] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:45.008729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.031416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.078791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5718b9-0e28-4f86-af4e-73deec6f2a2a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.116630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.117210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.117517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.117857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.125534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.127276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.130538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db278a5d-bf67-4916-92d0-1f32c170c7b4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:45.139285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:45.140283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:45.141254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 383/752] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:57:44 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:45.145601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.187684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.188565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.188838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.189111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.189837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:45.190140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.191577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.205924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 370/753] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:45.206767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.235186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.288192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.292056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc788118-c486-4827-83db-73197bc10e81 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.314651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de55e6f-0c26-4904-a434-fa3b66e91322 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.331048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.332115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.332697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.333211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.345543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.347598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.349909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.350529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.350808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.351084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.351886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:45.352199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.354017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:45.365199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:45.366202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:45.367220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:45.367220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:45.367220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:45.373460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 371/754] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:45.373818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.374281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 384/755] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:45.376576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.478811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e898259-55ac-4bdd-8c04-0f31df630f4b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.488968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26328f34-7f1c-40a1-a829-62e77ad6a448 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.496703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.508432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.515571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.516187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.516539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.516728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.517486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=ba26775b8b3c49ae878e8ca696c3cda5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:45.517794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.519357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.526120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 372/756] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/role_assignments?user.id=ba26775b8b3c49ae878e8ca696c3cda5&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:45.526808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.532347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.533376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.533900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.534377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.535293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:45.535815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.537633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.552824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 385/757] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:45.559408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.641823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db0871f-3eb6-45d9-8418-a93e12cab551 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.672801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8020c6-1532-4ad3-b713-cda22368b17a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.679941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.680718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.681008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.681314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.714128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.715854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.716425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.716996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.724779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.726660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:45.739780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:45.740792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:45.741743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:45.744362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 386/758] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:45.750718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.770364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.779349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.780934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e4596a-3a0c-4711-8815-b37989bdab8a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.787610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:45.870019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30824030-86d0-4499-b99c-4d8be665c6b0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:45.907726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 373/759] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:57:45.909399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d39cc4-4908-4914-8f04-eb62458c7315 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.909977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d39cc4-4908-4914-8f04-eb62458c7315 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.910548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d39cc4-4908-4914-8f04-eb62458c7315 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.912755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 374/760] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:45.913780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d39cc4-4908-4914-8f04-eb62458c7315 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:45.917410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:45.919036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.919324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.919609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.920323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:45.920632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:45.922113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c3afea-9f27-47db-880f-47b286b17339 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:45.943792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 387/761] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:45.943792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44048f-e695-423f-b801-fc283f648503 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:45.943792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44048f-e695-423f-b801-fc283f648503 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:45.943792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e44048f-e695-423f-b801-fc283f648503 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:45.964261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7e44048f-e695-423f-b801-fc283f648503 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:45.966558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7e44048f-e695-423f-b801-fc283f648503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:46.028578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.042932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d39cc4-4908-4914-8f04-eb62458c7315 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.057304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 388/762] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:45 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:46.058235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44048f-e695-423f-b801-fc283f648503 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.082844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.083990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.084502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.085061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.087302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.098682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.100744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:46.117010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:46.118051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:46.119002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:46.119002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:46.119002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:46.119002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 375/763] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:46.124046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.232281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f96be9-8f33-42c7-96e5-97e15c7c41f9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.261612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e44048f-e695-423f-b801-fc283f648503 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.273878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.274549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.274832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.275200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.275848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:46.276148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.278338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.304474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 376/764] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:46.311335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.328774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.338110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.338852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.339127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.339401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.343536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=1c86910525fd489eae437f3cedc7443c, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.347479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.376242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 389/765] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:46 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:46.444998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72441380-52a2-4bf9-a80a-66e0b5dd1c8c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.482387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.482963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.483242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.483517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.491247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.492725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.495067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:46.515788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:46.516771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:46.517718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 377/766] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:46.526608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.628171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.628893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.656007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccda7e4c-f502-41c2-adf6-cc875a2bbe0a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.663510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048e4d48-2544-4b09-a9b3-b3f2e9ebe8b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.693308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.693989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.694236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.694564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] PATH_INFO: `/v3/services/network` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.695168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.696539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.700694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.701479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.701758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.702033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.702739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:46.703048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.704479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:46.707687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:46.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:46.709599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:46.713303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 390/767] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/services/network => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:46.715004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.719319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 378/768] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:46.726326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.820867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f10873-4978-465f-a693-ecb9716dc467 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.833428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f7267b-631e-4c6e-9283-2b80c6034153 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:46.863840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.864469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.864748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.865024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.865694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:46.865997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.867367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.875799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 391/769] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:46.883802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:46.885643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.897542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:46.901564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:46.902187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:46.902998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:46.903272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:46.904140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=a46db75abedb406987ba37de1bf81424) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:46.904476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:46.905996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:46.920169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 379/770] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/role_assignments?user.id=a46db75abedb406987ba37de1bf81424&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:47.020352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186d4313-f726-455b-ad35-0abb9ac20bbe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:47.058221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:47.059461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.059847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.060182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.060828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:47.061200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:47.062593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad33c00-3d13-4ec6-bdc4-036712ef7a39 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:47.068436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 392/771] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:46 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:47.075023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:47.150241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a132-520b-472f-ac15-ef8dbbb094f1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.150718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a132-520b-472f-ac15-ef8dbbb094f1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.151467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f2a132-520b-472f-ac15-ef8dbbb094f1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.154330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 393/772] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:47.160158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.160444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.160723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.200517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:47.201773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:47.253218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cec3820-ece4-4597-8191-925acefe8331 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:47.288608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:47.289257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.289587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.289865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.290639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] RBAC: Adding query filter params (interface=public, service_id=1bc2eae7c8dd47f8b6dad466fe348efe, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:47.290953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:47.292362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:47.302086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 380/773] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:57:47 2022] GET /identity/v3/endpoints?service_id=1bc2eae7c8dd47f8b6dad466fe348efe&interface=public®ion_id=RegionOne => generated 194 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:47.312749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:47.325341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:47.332992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 394/774] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:47 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:47.410681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:47.470908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf4807f-c2da-4842-8e67-027064a65918 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:47.523271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:47.523876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.524153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.524423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.525024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:47.526409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:47.537825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 381/775] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:57:47 2022] GET /identity/v3/services => generated 772 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:47.693051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:47.812526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb84952-6eea-4c9d-81e4-05ed2aeda40a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:47.850347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:47.850980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:47.851256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:47.851523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:47.852105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:47.853486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-31ca73db-6d3b-4d4d-8472-22ee42cb3e0b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:47.862927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:47.863932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:47.864791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 395/776] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 04:57:47 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:47.872628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.009207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60b28-56b9-4bb0-852b-c2d3e59931cd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.009539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60b28-56b9-4bb0-852b-c2d3e59931cd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.009745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b60b28-56b9-4bb0-852b-c2d3e59931cd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.011308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 396/777] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:48.018890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.019343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.019737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.024716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba24245-59f8-4b12-98a7-f29b53e7abb1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:48.048163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:48.054222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:48.055517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:48.069361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:48.070248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.070666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.071106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.071876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:48.072318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:48.073825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:48.079853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 382/778] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:47 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:48.090475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.129702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:48.141489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 397/779] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:48.279384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6527b99-ec85-4e98-93b3-167d93d66126 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:48.325965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:48.326942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.327444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.327917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.328741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:48.329277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:48.330833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:48.340363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 383/780] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:48 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:48.346420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.481560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eac22b1-a004-4cff-b5c4-4a532a6bc362 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:48.531327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:48.531837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.532101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.532372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.533079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] RBAC: Adding query filter params (interface=public, service_id=28d575f554774da3a3190f3cfd2323b8, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:48.533413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:48.534779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:48.543139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 398/781] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:57:48 2022] GET /identity/v3/endpoints?service_id=28d575f554774da3a3190f3cfd2323b8&interface=public®ion_id=RegionOne => generated 194 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:48.548765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.583298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.646652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:48.673747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:48.710964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8ce740-ebd1-49f4-a0da-06b1a834eb20 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:48.753658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b030f-8141-4ebe-96e7-613d0a40f5a6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:48.778092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:48.779140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.779620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.780976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.799112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:48.809205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:48.810151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:48.810991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 399/782] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:48.812801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:48.813454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:48.813734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:48.814008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:48.814620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:48.815975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:48.817816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:48.835399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 384/783] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:57:48 2022] GET /identity/v3/services => generated 772 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:48.999975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a45284-2eb3-4fc6-b3a1-542605458ab3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.025043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:49.051717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.052260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.052541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.052814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.053514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:49.053815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:49.055181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ec01-89a9-415d-9312-7e7b6fb62d4d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:49.064589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 400/784] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:49.069907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.109006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f228-3277-43cc-b092-8737eb9a1412 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.109381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f228-3277-43cc-b092-8737eb9a1412 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.109628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1936f228-3277-43cc-b092-8737eb9a1412 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.111549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 401/785] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:49.116358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063efe9-a198-4860-bfd4-49b7037704cf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.116657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063efe9-a198-4860-bfd4-49b7037704cf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.116922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7063efe9-a198-4860-bfd4-49b7037704cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.137159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7063efe9-a198-4860-bfd4-49b7037704cf None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:49.138123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7063efe9-a198-4860-bfd4-49b7037704cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:49.220517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 402/786] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:57:49.221902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206471-becf-4712-aaff-7339ced332f2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.222183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206471-becf-4712-aaff-7339ced332f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.222477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6206471-becf-4712-aaff-7339ced332f2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.225783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 403/787] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:49.233303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.233680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.233965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.237813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a1b5a7-ba15-4640-9236-5d7a787679d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.259748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:49.260984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:49.264829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:49.324619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.325800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.326292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.326857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.347023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:49.351433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:49.382905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:49.383903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:49.384792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:49.384792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:49.384792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:49.387027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 385/788] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:49.397470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.507678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 404/789] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:49 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:49.520607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.565543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:49.577709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d1bc9-1c9d-4a90-b601-4227c5673a31 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.613428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.614040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.614320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.614596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.615246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:49.615551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:49.616915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:49.630993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 386/790] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:49.631365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2561d2c-5ca3-4cf8-8eb6-b23602f802da None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.635982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.685680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:49.689686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.690374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.690600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.690875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.718251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:49.723109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:49.724058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:49.724910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:49.733946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 405/791] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:49.743033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.865555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:49.869753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f425bf-42ed-48e1-bf21-051a7eb32d18 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.913170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.913802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.914081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.914350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.915358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:49.915665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:49.917494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:49.927337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 406/792] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:49.928153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:49.941563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b525801e-d10b-4651-8b8a-14d187238cd1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:49.979598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:49.980247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:49.980527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:49.980796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:49.987957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:49.989415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b67cc373-30e3-489b-988f-4011715190fd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:50.000348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.001493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:50.002899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.005322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 387/793] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/users/swift => generated 83 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:50.007587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039859-e4e7-4c01-ba07-fe972b904881 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.007862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039859-e4e7-4c01-ba07-fe972b904881 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.008131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7039859-e4e7-4c01-ba07-fe972b904881 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.009498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 388/794] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:50.013552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7039859-e4e7-4c01-ba07-fe972b904881 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.048178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3f57b5-4f2a-4076-8890-77303407415f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.083126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.083756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.084032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.084306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.095431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:50.100151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.101071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:50.101954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 407/795] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.102644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.114366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.127660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.134797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7039859-e4e7-4c01-ba07-fe972b904881 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.171619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.172467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.172889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.173362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.186851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.188619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e48e753b-0770-4cdd-bfcf-f7277d59f693 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:50.204790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.205995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:50.207031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:50.207031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.207031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.212949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f1c6d-a4fb-4730-a2e6-cd0004077f5d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.213486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 389/796] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.215005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.215541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.215815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.234628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:50.235817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:50.248500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.249108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.249431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.249704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.250507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:50.250812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.252554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.270578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 408/797] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:50.274399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.314252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 390/798] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:50.315207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.358102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.384991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b2035e-f08f-4359-b204-5c544b8277d6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.414921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.422190 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.423158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.423728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.424209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.425130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:50.425656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.427681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.443626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 409/799] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:50.443626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.458625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d5ab79-7d9f-45de-8560-afa36ed8cf58 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.501749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.502394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.502668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.502988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.503871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:50.504174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.505916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.521505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 391/800] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:50.522373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.569590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0040d671-5e38-43f3-bc7a-bd1a544e1ce2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.610588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.611222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.611499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.611768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.621990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.624778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.627209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:50.644068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:50.646080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:50.646080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.646080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:50.646080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 410/801] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.646080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.648524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f8e39-e08c-49a2-9739-8286f39209f0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.676527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.687239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.687879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.688160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.688436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.700228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.701708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:50.715977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.716966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:50.717905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:50.717905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:50.717905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.717905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 392/802] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.718489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.758960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08460ef5-3617-41bb-b42c-f792a78b3f15 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.797678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.798678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.799152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.799626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.807825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.809985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:50.821417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.822417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 411/803] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.823363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.832620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d017a5-df7b-4486-9b9b-dad50017e52e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.870311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.871021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.871263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.871533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.872299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.873571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.879478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:50.882725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:50.883700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:50.884559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 393/804] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/services/network => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:50.885388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:50.930756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:50.941527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e8598-68ba-4e1c-81d1-7d8030cea885 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:50.976505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:50.977111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:50.977421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:50.977706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:50.978331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:50.978637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:50.979993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:50.992270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 412/805] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:50.993101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.001001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9f12ac-b85d-4182-bce7-d81fefeb0b15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.037157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.038015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.038548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.038822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.039457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.039781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.041216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.055173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 394/806] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.055955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.105525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa500aa4-a1e3-4d3d-a1d2-545ab77df1f4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.119078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.142565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.143173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.143451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.143722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.144455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.144755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.146197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.157420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a9ca9c-3fa6-495a-8bfa-719910d381bc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.158923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.163592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 413/807] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:57:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.164392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.196279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.196809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.197085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.197385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.198008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] RBAC: Adding query filter params (name=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.198308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.199774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.204453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 395/808] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.209084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.263923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b54009-dde6-40c1-b42e-2d220aeb0ce7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.300517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.301140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.301452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.301722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.307621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1415e8e8-f4d1-4cbb-bf2f-42085de3bf9b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.308619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.310084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4c8f45b1-ed5d-4ce9-b025-1f8c37140014 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:51.320797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:51.321966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 414/809] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:51.323087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f4a64-2d28-4966-916e-ebee63db883a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.323766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f4a64-2d28-4966-916e-ebee63db883a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.323766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3f4a64-2d28-4966-916e-ebee63db883a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.324698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 415/810] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:51 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:51.325408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f4a64-2d28-4966-916e-ebee63db883a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.348001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.348630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.348908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.349203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.356559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.356975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.358056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:51.369327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:51.370460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 396/811] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:51.371605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.398072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.431224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3f4a64-2d28-4966-916e-ebee63db883a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.463950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.464513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.464792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.465062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.469900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55186f4-23ad-4900-bd9d-62e7dfa78d3c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.476143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.477612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:51.491428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:51.492543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:51.493650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:51.493650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:51.493650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:51.493650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 416/812] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:51.493919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.504575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.505173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.505478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.505750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.506370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.506667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.507998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b60d70-f9df-4335-be49-432f545e05e5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.513344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 397/813] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/services?type=network => generated 350 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.514349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.514627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.514898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.533791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:51.535009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:51.581997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.599841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa488e8-f3d7-40b0-af78-98b07f5e566f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.602159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 398/814] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:51.603161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.624583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.637928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.638612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.638803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.639071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.639751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.640049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.641483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.659072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 417/815] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.659806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.705977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746085f7-b222-4bb4-b703-918dedd0eefa None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.739261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.739784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.740063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.740329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.741045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.741388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.742797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.760965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 399/816] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.762495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.769308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50953bac-1c17-4c47-b332-fc24c5262b5e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.805815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.806523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.806805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.807076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.807828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:51.808695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.810074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.826753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 418/817] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:51.826753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.826753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.847756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:51.876138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f43f58-c1ce-445b-b109-2eb834df41c2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.912980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.913612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.913891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.914164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.914820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.916172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:51.926767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5074c933-01cc-4b1b-8fc9-1de6ec1fa882 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:51.942199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 400/818] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:57:51 2022] POST /identity/v3/endpoints => generated 337 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:51.943086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:51.983841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:51.984523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:51.984805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:51.985077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/ba26775b8b3c49ae878e8ca696c3cda5/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:51.987729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=ba26775b8b3c49ae878e8ca696c3cda5, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:51.989259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.006642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 419/819] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:51 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/ba26775b8b3c49ae878e8ca696c3cda5/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:52.007828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.076057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a3ab9fa-624d-4b53-a708-780f477e2ef5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.109460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.129227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.129834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.130915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.130915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.133332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.175915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e85d6-fb75-4423-b356-03c2fa1ec9cd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.216651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.217320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.217596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.217862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.218975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.220787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.226780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.228215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:52.239906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:52.240866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:52.241833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 420/820] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:52.242329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.333955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 401/821] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:51 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:57:52.334875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.361250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20f680-4aca-4e17-8594-e3cb907f06ba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.370384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.380986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.398789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.399713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.399996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.400263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.400841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.402382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:52.411794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:52.412769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:52.413668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 421/822] 10.222.0.43 () {56 vars in 1129 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:52.414461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.446368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6feada5-9aff-4e39-9792-94f9c8109b6e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.482653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.483252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.483525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.483793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.484473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:52.484772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.486230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.498250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 402/823] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:52.499074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.531027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383260b5-d61f-46ef-b8d9-4c7538c7734f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.565519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.566151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.566430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.566753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.577968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.579408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:52.593936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:52.595069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:52.596184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:52.596184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:52.596184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:52.599729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 422/824] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:52.600161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.600520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.608294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76c7820d-61c7-4550-8722-e74ba5869500 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.636047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.643767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.644515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.644894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.645300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.646031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:52.646432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.647911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.652822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 403/825] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:52.653499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.707043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7a6c76-7aea-4bba-ad17-f176f37dbf01 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.739692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.740342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.740618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.740886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/a46db75abedb406987ba37de1bf81424/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.755645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=a46db75abedb406987ba37de1bf81424, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.757063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.758616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24dece0-ba9f-469c-afd6-5c4bd743c62d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.777219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 423/826] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:57:52 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/a46db75abedb406987ba37de1bf81424/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:57:52.777219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.810794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.811673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.811958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.812234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.812893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:52.813222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.815641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.837400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 404/827] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:52.840015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.870370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.890836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:52.915549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a3586c-ff8e-431e-a3b0-605c52faf338 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:52.956438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:52.957046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:52.958150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:52.958150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:52.958345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:52.958550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:52.959911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:52.965650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 424/828] 10.222.0.43 () {56 vars in 1124 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:52.971392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:52.989460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec1e6db-0cde-49d4-90c5-5b3b12c6ed61 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:53.035658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:53.037082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:53.037652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:53.039019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:53.048711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:53.051290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:53.066146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:53.067287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:53.068443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:53.075022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 405/829] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:53.076389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:53.091107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8bfef9-a5dd-49be-8bcd-ef027ab7810b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:53.134035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:53.134881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:53.135308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:53.135724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:53.137711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:53.140162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:53.177234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 425/830] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:57:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:57:53.177622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:53.203928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d8876a-c68f-4209-8cf6-61962e15f6ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:53.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:53.254255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:53.254467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:53.254746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:53.255461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:53.255765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:53.257363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c693057-56c7-45f7-ad8a-7c56f82e8e1f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:53.276776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 406/831] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:53.286414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:53.290782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:53.401064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81c499c-58ae-49e5-9a96-44376e971375 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:53.436793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:53.437441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:53.437724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:53.437995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:53.438735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:53.439044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:53.440473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c36f80-8eba-43df-a580-125f20f9f256 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:53.453368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 426/832] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:53 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:54.000778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3a91-9610-4296-b829-62faa57d27d2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.001128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3a91-9610-4296-b829-62faa57d27d2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.001625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0d3a91-9610-4296-b829-62faa57d27d2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.003279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 407/833] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:54.008194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.008625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.008719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.028557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:54.030062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:54.093419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:54.100122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 427/834] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:54.364983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3a91-9610-4296-b829-62faa57d27d2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:54.470890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0d3a91-9610-4296-b829-62faa57d27d2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:54.505276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:54.505913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.506190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.506467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.508303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:54.517693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:54.522513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:54.523450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:54.524295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 408/835] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:54.535620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:54.639100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b495460-0bda-4aaf-ab75-c561d1a766db None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:54.673946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:54.674553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.674830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.675102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.675766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:54.676064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:54.677448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c1fe96-9b4f-4adf-a366-68cb7ee38cf6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:54.686655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 428/836] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:57:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:54.694264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:54.745092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4278-e710-4d79-99bd-68c09bbde88f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.745506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4278-e710-4d79-99bd-68c09bbde88f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.746409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb4278-e710-4d79-99bd-68c09bbde88f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.747877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 429/837] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:57:54.753033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.753342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.753613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.771865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:54.773404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:54.809634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2fd4ca-677d-419b-a28f-a1dfbe0c66b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:54.845210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:54.849253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 430/838] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:54 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:57:54.864239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:54.864918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:54.865216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:54.865495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:54.877085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:54.878563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:54.894530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:54.895505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:54.896444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:54.896444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:54.896444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:54.896444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 409/839] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:54.902226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.004787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ddd755-0a21-4caf-9274-a9794adf340f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.039664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.040409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.040568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.040795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.041464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:55.041765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.043824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.055976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 431/840] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:55.062230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.112209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.134837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.182026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f33c628-176d-4695-bb2b-d7a32dcaf87e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.204822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.221876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.222611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.222896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.223172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.231809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.233555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:55.248344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:55.249400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:55.250440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 410/841] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:55.256105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.271270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de98ecf1-2f5a-4d5f-9f87-0243d241e282 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.311735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.312470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.312748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.313015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.324014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fbbaef51-c826-422a-830c-508781c6a699 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:57:55.329611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:55.330546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:55.331423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 432/842] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:55.332140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c6c-5c25-4f85-885e-562bd0230249 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.332208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c6c-5c25-4f85-885e-562bd0230249 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.332792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93383c6c-5c25-4f85-885e-562bd0230249 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.333807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 433/843] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:55.339295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383c6c-5c25-4f85-885e-562bd0230249 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.371471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f47d473-00f8-497d-b06e-f6ebfea5c12f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.380510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.415466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.416613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.417140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.417624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.419181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:55.419700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.421278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9501d0f1-1c2c-4105-9c06-84d93be04b13 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.445305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93383c6c-5c25-4f85-885e-562bd0230249 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.446081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 411/844] 10.222.0.43 () {56 vars in 1135 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:55.447514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3366d-ba37-4ac9-8c9b-9486d60d0069 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.447916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3366d-ba37-4ac9-8c9b-9486d60d0069 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.448202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef3366d-ba37-4ac9-8c9b-9486d60d0069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.459460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.468431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ef3366d-ba37-4ac9-8c9b-9486d60d0069 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:55.469657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ef3366d-ba37-4ac9-8c9b-9486d60d0069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:55.487045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.487801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.488298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.488783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.489504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:55.489819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.491481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.503595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 434/845] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:55.504424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.541537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 412/846] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:55.543396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd57ff-76a7-49e3-a999-45c18d2537bf None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.543676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd57ff-76a7-49e3-a999-45c18d2537bf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.543949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd57ff-76a7-49e3-a999-45c18d2537bf None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.549545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 413/847] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:55.549545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd57ff-76a7-49e3-a999-45c18d2537bf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.610756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253d3ebe-d516-47bb-9ed0-6d8a2c862fee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.647016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.647845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.648119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.648388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.652604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.661099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd57ff-76a7-49e3-a999-45c18d2537bf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.694149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.696361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.696946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.697225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.697523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.707698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.709134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.723133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-de31a723-8be9-4842-9bc7-6b58f8a9a98b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:55.724342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:55.725445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:55.732062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:55.732062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:55.732062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:55.732270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.732365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 414/848] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:55.732365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.732365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.732365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.748343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:55.749757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:55.821306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 415/849] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:55 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:55.822148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.844173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 435/850] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:57:55.849575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:55.904561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.925268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:55.929120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedfb607-87d6-4920-ac08-306e3504c3f6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.958944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636c1b7d-abc4-41d0-9e3a-19703fdfa200 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:55.968618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:55.969368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:55.969715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:55.969997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:55.970642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:55.970945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:55.972295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:55.984019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 416/851] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:55.984810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.000894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.001600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.001879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.002150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.002731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.004080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:56.013356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:56.014353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.015224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 436/852] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:56.016103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.098777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7d511a-9345-496e-b6b0-f3154887f10c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.119053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd0dde2-48fd-4d73-be8c-1b620fcce368 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.133639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.134276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.134552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.134827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.138692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.147459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.148898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.153997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.154625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.154904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.155176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.157861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.163108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:56.163654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:56.164728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:56.170398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:56.170398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:56.170398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:56.170398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 417/853] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:56.170683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.170768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:57:56.180702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:56.181872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 437/854] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:56.183126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.270974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47a7c7-4aeb-4c0e-9a26-a8ef6331c828 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.282571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7574ee38-c771-4e85-b21c-18c234f6354d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.304095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.304697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.304975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.305282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.305909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.306211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.307570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.312395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 418/855] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.313173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.316662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.317379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.317656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.317926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.318505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.319869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:56.329368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:56.330486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:56.331564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 438/856] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:56.332529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.369602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.390150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.417147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8977938b-31b0-4cf8-82aa-b7f9ad9ebac7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.431427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dd9066-b131-4bd4-bc23-2e77fca26b4f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.450650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.451243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.451522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.451792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.452421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.452744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.454103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.466197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.466796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.467072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.467345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.468143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.468450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.468570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 419/857] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.469358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.469897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.487545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 439/858] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.488355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.571607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b751fc06-fb81-4962-94e9-886ae6287601 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.584764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.585942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f278d7-118d-4f4f-90e5-072fbfc75adf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.603415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.607069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.607674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.607954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.608227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.608851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.609152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.610525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.614801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 420/859] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.615569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.622720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.623355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.623632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.623900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.624549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.624841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.626555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.637605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 440/860] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.637605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.737508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ca61b9-e948-4a10-83ef-2300adfb0a86 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.743712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f7b1cc-07d2-4ef2-b7b5-8c2c0d999733 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.779738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.780588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.780963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.781380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.786350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.786966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.787252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.787531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.789077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.790813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:56.806354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:56.807366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:56.809170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:56.815968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 421/861] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:56.815968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.838183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.854463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:56.861731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.863294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.923636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d274e9-db7b-429c-93a8-e65558de6cce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:56.960521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:56.961133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:56.961455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:56.961840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:56.962476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:56.962776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:56.964158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:56.969054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 422/862] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:56.969874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:56.989647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 441/863] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:57:56.991038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.099930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:57.103632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0280adb5-338f-41f8-9421-a82bd54b2e58 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.116513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:57.147253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abe579-0ecb-47d0-96d3-bb10bf58099c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.149141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.149918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.150200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.150472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.151175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:57.152000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.154064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.173384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 423/864] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:57.174704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.188517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.189272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.189653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.190164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.204556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.206559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:57:57.227060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:57.228281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:57:57.229397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:57:57.229397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:57:57.229397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:57:57.229397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 442/865] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:57.235322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.291867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae88e4b-e309-4ab0-b9ae-68809db147d2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.328434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.329047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.329367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.329642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.330550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=ba26775b8b3c49ae878e8ca696c3cda5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:57.330863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.333108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.340545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 424/866] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:57 2022] GET /identity/v3/role_assignments?user.id=ba26775b8b3c49ae878e8ca696c3cda5&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:57.367167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd4c1f4-eb3b-430d-937c-0a1b7282c2f2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.405964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.406698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.407052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.407396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.408138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:57.408511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.410011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.411821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:57.424128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 443/867] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:57.429804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.459041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:57.543613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1effccbd-aec0-4ee7-8c91-c2b061b8c2fa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.579470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.580208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.580557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.580904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.588326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.590434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:57:57.602340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:57.603430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:57:57.604599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:57.608254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 425/868] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:57:57.611436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.719488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd2eb0-95fd-448b-9633-75778fa6be87 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.755216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.755926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.756277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.756619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.757411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:57.757791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.759278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699f832d-a1c8-43b5-a429-11f8331010a7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.772085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 444/869] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:57:57.778721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:57.867263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:57.886941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9260654d-e08c-4fbc-a707-8d72231fa136 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:57.921685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:57.922289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:57.922569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:57.922846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:57.923567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=a46db75abedb406987ba37de1bf81424) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:57:57.923875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:57.925317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0944f1a-2a90-4220-8524-e293d78bf1ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:57.931591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 426/870] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:57:57 2022] GET /identity/v3/role_assignments?user.id=a46db75abedb406987ba37de1bf81424&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:57:58.558494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5485-a8bb-48f6-9ba4-f8434bb17eb3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:58.559126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5485-a8bb-48f6-9ba4-f8434bb17eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:58.559126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea5485-a8bb-48f6-9ba4-f8434bb17eb3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:58.560918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 445/871] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:58.566217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e1ef-4969-4ce4-96b4-bfdc9d248623 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:58.566628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e1ef-4969-4ce4-96b4-bfdc9d248623 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:58.566949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c79e1ef-4969-4ce4-96b4-bfdc9d248623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:58.586484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6c79e1ef-4969-4ce4-96b4-bfdc9d248623 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:58.587663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c79e1ef-4969-4ce4-96b4-bfdc9d248623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:58.660499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 427/872] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:58 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:58.929357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea5485-a8bb-48f6-9ba4-f8434bb17eb3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:58.996487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.023251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183232-8cc6-4ebe-8262-9ac5a08c99a0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.023553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183232-8cc6-4ebe-8262-9ac5a08c99a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.023797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183232-8cc6-4ebe-8262-9ac5a08c99a0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.025392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 428/873] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:59.030633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d52a98-bf09-4b75-a64d-397fd83e1cf4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.030928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d52a98-bf09-4b75-a64d-397fd83e1cf4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.031211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d52a98-bf09-4b75-a64d-397fd83e1cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.044595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea5485-a8bb-48f6-9ba4-f8434bb17eb3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:59.053079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-00d52a98-bf09-4b75-a64d-397fd83e1cf4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:59.054789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00d52a98-bf09-4b75-a64d-397fd83e1cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:59.085878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:59.086744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.087023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.087542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.088218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:59.090896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c6f807-174f-4d8b-87ba-b4dfdf50c091 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:59.118057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 446/874] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:57:58 2022] POST /identity/v3/services => generated 251 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:57:59.152399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 429/875] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:59.391814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9911-7bdd-4cb7-9599-8f1a0932d823 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.392346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9911-7bdd-4cb7-9599-8f1a0932d823 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.392771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ec9911-7bdd-4cb7-9599-8f1a0932d823 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.394543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 447/876] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:57:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:57:59.400088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.400645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.401122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.409482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.420294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:57:59.421804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:57:59.427752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec9911-7bdd-4cb7-9599-8f1a0932d823 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:59.494934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 430/877] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:57:59 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:57:59.534283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ec9911-7bdd-4cb7-9599-8f1a0932d823 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:59.549770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.570629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:59.571247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.571508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.571782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.572447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:59.573882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:59.596140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 448/878] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:57:59 2022] POST /identity/v3/services => generated 269 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:57:59.768252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:57:59.879085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befc3ba4-6f1b-422f-9813-28d54982b6ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:57:59.915292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:57:59.921762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:57:59.922693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:57:59.923175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:57:59.923647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:57:59.924444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:57:59.926019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e27c5cae-8730-45b1-a61d-b3ff54fd557e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:57:59.936377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:57:59.937423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:57:59.938279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:57:59.945278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 431/879] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:57:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:57:59.947263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:00.020264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363e5a-d40a-4223-8d5d-51d773415c4e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.020869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363e5a-d40a-4223-8d5d-51d773415c4e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.021369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18363e5a-d40a-4223-8d5d-51d773415c4e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.024112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 432/880] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:00.030090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.030371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.030648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.049010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:00.050357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:00.066567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0a5bb8-6a3c-40b3-996b-b4e18f49fb3e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:00.111454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:00.112585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.113449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.114234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.115221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:00.115735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:00.117860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:00.127817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 449/881] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:57:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:00.129371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 433/882] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:00 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:00.129690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:00.174149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:00.234476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9bd5c2-fd61-4af1-8b5c-29df0433df5b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:00.268856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:00.269876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.270436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.270910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.271740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:00.272241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:00.273837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:00.285344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 450/883] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:00 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:00.413314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:00.517199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc24197-44c3-46c8-84e4-53dd654a3797 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:00.541271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:00.553500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:00.554136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.554418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.554691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.565174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:00.569961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:00.570883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:00.572123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 434/884] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:00.577861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:00.684430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a80c60-bd97-4c0e-b2f3-6b4d1d48e158 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:00.686024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:00.721964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:00.722600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.722882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.723157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.723849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:00.724153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:00.725595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:00.736058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 451/885] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:00.741695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:00.851144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6490d1fd-37d4-47a7-b1b5-68c7f140cffd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:00.887433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:00.888069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:00.888349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:00.888626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:00.898947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:00.900396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:00.915592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:00.916567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:00.918944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:00.918944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:00.918944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:00.918944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 435/886] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:00.923406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.035279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75afa566-a2fa-4639-aa81-a452fb9c7c74 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.072794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.074000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.074449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.074726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.075433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:01.075737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.077100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d62e0-2f18-4071-81a9-035827d076d5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.089779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 452/887] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:01.098522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.138384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.148691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d502-c913-4435-822d-87c638a356db None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.148969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d502-c913-4435-822d-87c638a356db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.149287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252d502-c913-4435-822d-87c638a356db None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.151005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 453/888] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:01.156436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.156996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.157309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.178044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:01.180000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:01.201794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.218997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e964498d-1946-461f-a7dc-2afa85f62576 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.265070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.265369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 454/889] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:01.266289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.266574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.266875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.279355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.280933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:01.293212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:01.294200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:01.295608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 436/890] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:01.301015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.407062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd19021e-015d-47b0-be9a-84a6ef2f45dc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.442719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.443341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.443629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.443904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.444645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:01.444953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.446422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.465902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 455/891] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:01.471493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.541066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.556796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.580604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.589170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b4b9a7-fb9d-4589-9b4c-cd04e36b6e41 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.626047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.626647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.626926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.627197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.656450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99993479-c35d-42ca-a91d-05a1554b0e4b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.694606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.695163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.695440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.695865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.696281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.697672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.702947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.704389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f33a3a8-9498-441e-b66e-8ffa0b597ae3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-49815cb0-e7d2-4c89-9e7b-1c9d52d1c4b1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:01.708376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:01.709626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:01.710502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 456/892] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:01.711317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ebc6b-a2d0-4707-847d-edf5a45fb6f2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.711317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ebc6b-a2d0-4707-847d-edf5a45fb6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.711848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57ebc6b-a2d0-4707-847d-edf5a45fb6f2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.712850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 457/893] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:01 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:01.715952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ebc6b-a2d0-4707-847d-edf5a45fb6f2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.798417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.813441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:01.820937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 437/894] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:01.824815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57ebc6b-a2d0-4707-847d-edf5a45fb6f2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:01.826944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.827908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.827908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.847423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:01.848673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:01.859907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:01.860512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:01.860801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:01.861073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:01.861732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:01.862033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:01.863384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:01.868058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 458/895] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:01.868670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.929646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 438/896] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:01 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:01.930524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:01.995648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c0a364-a45e-4839-b19b-6a5db3ac0b13 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.034916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.035979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.036496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.036969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.047870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.050443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.052539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:02.068964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:02.070169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:02.071189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:02.071189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:02.071189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:02.071370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b497f-9c81-414b-b400-d730f3fe4f56 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.077640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 459/897] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:02.079201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.101034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.113918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.114782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.115059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.115334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.115963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.116261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.118310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.129113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 439/898] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:01 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:02.131179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.216339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915867b3-9724-4810-8eb8-07b78f2362a7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.252848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.253562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.253840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.254113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.254817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.255102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.256467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.266590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e881e1b-c4b8-4223-ba3e-11c132c351ff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.274757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 460/899] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:02.274757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.315085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.315774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.316114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.316451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.317229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] RBAC: Adding query filter params (interface=public, service_id=c32c840962114260ac93ccf4cdc99844, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.317601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.319010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.329427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 440/900] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/endpoints?service_id=c32c840962114260ac93ccf4cdc99844&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:02.329427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.338118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.386388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.392173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bac6e5-0371-4336-a020-95f019d2770f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.429546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.430276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.430573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.430943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.431519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.433469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.434833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8a6fc-e649-4543-a0ee-052ccf9f538c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:02.442682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:02.443770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:02.444813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 461/901] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:02.445838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.473784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.474332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.474605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.474881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.481392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.482803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ea5e0e5d-460e-49af-ae4f-5dbc75e6a238 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:02.493562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:02.494594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:02.496028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 441/902] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:02.496813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647dc4e-0bd2-40ea-becc-5aeed0823546 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.496910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647dc4e-0bd2-40ea-becc-5aeed0823546 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.497159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647dc4e-0bd2-40ea-becc-5aeed0823546 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.498530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 442/903] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:02.499074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647dc4e-0bd2-40ea-becc-5aeed0823546 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.548960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76185327-29ad-43ae-a9c5-b2752349b824 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.564851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.583173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.583771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.584047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.584314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.584919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.586294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.592606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 462/904] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/services => generated 1268 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 04:58:02.593240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.614812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c647dc4e-0bd2-40ea-becc-5aeed0823546 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.632025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.655061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.655682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.655963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.656235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.656881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.657218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.658715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf929e8e-c38a-4b0a-8d46-0ee8805fbcd8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.663723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 443/905] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:02.664982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.665328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.665611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.685760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:02.686986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:02.725598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cfda58-ceb6-4c48-b751-74d9791264a7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.762970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 444/906] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:02 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:02.764092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.768473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.769095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.769405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.769683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.770385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.770689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.772174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.785326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 463/907] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:02.793788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.846405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.878135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8bb6be-7583-4fe8-a71a-46ec0e96663a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.888679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:02.919743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.921009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.921706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.922134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.922946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.923258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5627fa-b066-43e6-a501-891082786b97 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:02.923567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.925377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.939364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 445/908] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:02.946826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:02.967781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:02.968452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:02.968735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:02.969008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:02.969874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] RBAC: Adding query filter params (role.id=dfe4456f13104a5e9f802ed64ad8971f, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=a46db75abedb406987ba37de1bf81424) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:02.970188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:02.971734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:02.985993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 464/909] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/role_assignments?user.id=a46db75abedb406987ba37de1bf81424&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=dfe4456f13104a5e9f802ed64ad8971f => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:03.050001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:03.060353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4684123-1e13-4a2b-9673-005000d2b2d3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:03.106959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:03.107589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:03.107866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:03.108140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:03.108855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] RBAC: Adding query filter params (interface=public, service_id=bf5b19a7960246d28d52d5234dc8b997, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:03.109457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:03.111333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:03.124027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 446/910] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:58:02 2022] GET /identity/v3/endpoints?service_id=bf5b19a7960246d28d52d5234dc8b997&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:03.126244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:03.168926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:03.175179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2614f5-2102-4048-91a1-be0e64cec3c7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:03.205583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:03.221166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:03.221801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:03.222123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:03.222395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:03.223043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:03.224984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e701a08-c2cf-45c1-8e15-5dab07368982 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:03.245666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 465/911] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:58:03 2022] POST /identity/v3/services => generated 241 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:58:03.254296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72067ec-7848-4683-b807-67adc84918ba None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:03.309016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:03.309681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:03.310056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:03.310335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:03.311050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:03.312431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655785a-d436-4740-94d2-5c277b9208f1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:03.319661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 447/912] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:03 2022] GET /identity/v3/services => generated 1497 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 04:58:04.567911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a900-ee9d-4801-ae78-9751e0a7bf38 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:04.568473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a900-ee9d-4801-ae78-9751e0a7bf38 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:04.568473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a900-ee9d-4801-ae78-9751e0a7bf38 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:04.570050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 466/913] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:04.575819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50618-1e7c-4b86-8fd3-8ba84a6d636b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:04.576213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50618-1e7c-4b86-8fd3-8ba84a6d636b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:04.576375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc50618-1e7c-4b86-8fd3-8ba84a6d636b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:04.594793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5dc50618-1e7c-4b86-8fd3-8ba84a6d636b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:04.595988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5dc50618-1e7c-4b86-8fd3-8ba84a6d636b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:04.673261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 448/914] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:04.941851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a900-ee9d-4801-ae78-9751e0a7bf38 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.017399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814d34-9500-433e-8190-0286ece692d7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.017702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814d34-9500-433e-8190-0286ece692d7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.017938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d814d34-9500-433e-8190-0286ece692d7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.019524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 449/915] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:05.024556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e826f-fd5a-4094-ada7-1325c9b30201 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.024843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e826f-fd5a-4094-ada7-1325c9b30201 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.025124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2e826f-fd5a-4094-ada7-1325c9b30201 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.044968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a2e826f-fd5a-4094-ada7-1325c9b30201 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:05.046299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a2e826f-fd5a-4094-ada7-1325c9b30201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:05.053013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a900-ee9d-4801-ae78-9751e0a7bf38 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.068908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.098401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.099031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.099305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.099576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.100156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.101545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:05.113201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:05.114351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:05.115308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 467/916] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:04 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:05.122155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.147936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 450/917] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:05.159578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.221814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ab2-360a-4ae3-a812-dfa8ae30617f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.222012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ab2-360a-4ae3-a812-dfa8ae30617f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.222271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cee1ab2-360a-4ae3-a812-dfa8ae30617f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.225313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 451/918] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:05.228767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88818f-4d38-4d16-86ba-4560a43c9a5e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.229634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88818f-4d38-4d16-86ba-4560a43c9a5e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.230053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c88818f-4d38-4d16-86ba-4560a43c9a5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.235993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf08cf5-cc5d-4919-aa66-37284e448de1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.248892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2c88818f-4d38-4d16-86ba-4560a43c9a5e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:05.250275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2c88818f-4d38-4d16-86ba-4560a43c9a5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:05.279545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.280429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.280693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.280969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.281781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:05.282381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.284018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.290348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 468/919] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:05.301762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.333330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 452/920] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:05.342005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339647-eee5-4b90-b7d9-6386d3ad2d3d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.342290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339647-eee5-4b90-b7d9-6386d3ad2d3d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.342570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3339647-eee5-4b90-b7d9-6386d3ad2d3d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.343877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 453/921] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:05.348738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.349022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.349329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.370739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:05.371933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:05.423394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.434535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf22ce3-20af-4f3a-a633-c94de8c3cd09 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.446282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 454/922] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:05.473894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.479266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.480123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.480565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.480994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.481833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:05.482277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.483770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.489368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 469/923] 10.222.0.43 () {56 vars in 1114 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:05.497576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.498174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.597837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e2f7c0-d571-437a-ba79-d728002f6955 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.617583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09179a68-6099-4de6-9d37-789d6093d50a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.635010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.635925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.636337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.636618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.646739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:05.652353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:05.653527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:05.654542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:05.658233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 455/924] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:05.658431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.659054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.659450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.659911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.660463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.661299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.663063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.685549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 470/925] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:05 2022] POST /identity/v3/endpoints => generated 346 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:05.686434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.708370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.770122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.798345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d200138-c25d-4f86-b53e-794a2e38c08a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.828891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24ab29-e2c5-43eb-b032-8c2090b4b0aa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:05.840372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.840752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.841030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.841356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.841947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.843315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:05.853536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:05.854921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:05.855790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 456/926] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/services/object-store => generated 93 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:05.856622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.877610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:05.878290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:05.878577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:05.878853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:05.879529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:05.879834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:05.881402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:05.898034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 471/927] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:05.898034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:05.974218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:05.974628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba7756a-669c-4cf5-b03f-a9b00809c07d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.008998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.009653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.009985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.010764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.011349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.012002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7437adc-df52-4e63-8921-de3e944cc992 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.012709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:06.021920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:06.022880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:06.023826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 457/928] 10.222.0.43 () {56 vars in 1132 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:06.024636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.029397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.051424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.052069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.052349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.052643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.053354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.053660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.055028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.061244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 472/929] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.061672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.132435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d274d03-2a77-4d1f-bf6d-5fe092daf0d5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.168168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.168793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.169075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b1b39c-e5fb-421f-bfc8-f75931ae8367 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.169300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.169402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.183220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.184693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:06.200103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:06.201122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:06.202330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:06.202330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:06.202330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:06.202330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 458/930] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:06.202330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.210090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.210709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.211000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.211277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.211914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.212220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.214427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.215717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.220300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 473/931] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.221103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.267590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.315215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2e3623-9509-4a49-a3d2-4f4bdb51a9ee None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.332392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a34bd-6b6c-4200-8b58-14949c2d114a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.350179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.350855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.351200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.351472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.352094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.352391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.353768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.359125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 459/932] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.360037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.374700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.375809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.376091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.376364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.377008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.377350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.378709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.395303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 474/933] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.395303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.453886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.475090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095256a1-fc4d-476e-a2cf-999822a895bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.496128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.497097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50d92b4-a14b-4ea9-aae7-8abfb7e80577 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.512688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.513522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.514057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.514330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.514967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.515271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.516756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.527236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 460/934] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.527862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.534356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.534961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.535235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.535503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.536196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] RBAC: Adding query filter params (interface=public, service_id=68a1ec04b14e48828dfd270bf1def90e, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.536498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.537869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.542948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 475/935] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/endpoints?service_id=68a1ec04b14e48828dfd270bf1def90e&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.548147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.633534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ae2926-2e90-4128-93a4-2903c693dc31 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.650393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dcb425-3cea-467a-a9c2-57bce326b4ec None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.671429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.672346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.672635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.672913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.673409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.681576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.683083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.689721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.690333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.690610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.690883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.691555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.692908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:06.695528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:06.696463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 461/936] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:06.697521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.725478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 476/937] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:06 2022] POST /identity/v3/endpoints => generated 347 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:06.725478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:06.772482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:06.840337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cabbc1-23d1-4842-a3d3-af9b6c978b27 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.857125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fab777-dc6c-4102-ae6d-bcb7e8844bc3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:06.878832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.879539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.879889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.880228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.880898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.882489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.894371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 462/938] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 04:58:06.898202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:06.898845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:06.899128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:06.899405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:06.900197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:06.900512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:06.902314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:06.929838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 477/939] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:06.937058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:07.057916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f81102-7c2b-4fb8-8cb1-d47297bffbf5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:07.070117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:07.096557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:07.097226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.097507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.097781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.109677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:07.111127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:07.126177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:07.127185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:07.128084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:07.128084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:07.128084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:07.128084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 463/940] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:07.134578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:07.167831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:07.239867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a9b865-ec21-4a24-bda4-d839881d4e9e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:07.277523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:07.278511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.279221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.279707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.280648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:07.281226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:07.283131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:07.296988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 478/941] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:07.302742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:07.409950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5876e83-5f09-4776-bfa3-d1ba30aaa4e2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:07.446272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:07.447264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.448284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.448825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.455907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:07.457604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:07.469938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:07.470878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:07.471774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:07.474189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 464/942] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:07.482282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:07.580334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:07.589536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19717048-c9c3-43d6-8bb9-d79fa5863ace None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:07.625951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:07.626567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.626842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.627112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.627802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:07.628100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:07.629579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380a5f9-654f-427b-8901-9c15b271897f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:07.643009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 479/943] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:07.648837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:07.667974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252abb-a03d-44a2-89ef-b89830a5173d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.668492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252abb-a03d-44a2-89ef-b89830a5173d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.668492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b252abb-a03d-44a2-89ef-b89830a5173d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.673590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 480/944] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:07.674513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:07.675276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.675388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.675605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.694487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:07.695691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:07.759227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f511a4d-597d-4ff6-a8eb-53b720003b13 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:07.769291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 481/945] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:07 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:07.796257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:07.797358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:07.797834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:07.798299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/a46db75abedb406987ba37de1bf81424/roles/dfe4456f13104a5e9f802ed64ad8971f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:07.800627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=a46db75abedb406987ba37de1bf81424, role_id=dfe4456f13104a5e9f802ed64ad8971f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:07.802346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:07.817680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 465/946] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:58:07 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/a46db75abedb406987ba37de1bf81424/roles/dfe4456f13104a5e9f802ed64ad8971f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:58:08.036245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:08.125632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:08.149359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbce48d-202d-4fce-a27e-32be6d30d63b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:08.186647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:08.187261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:08.187539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:08.187815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:08.188459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:08.189916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:08.192516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING keystone.server.flask.common [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 04:58:08.210248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.sql.core [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 04:58:08.210248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 04:58:08.210248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [parameters: {'id': '7ad647b2a3b54e7e9a890e3029b05b32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 04:58:08.210248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ad647b2a3b54e7e9a890e3029b05b32.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ad647b2a3b54e7e9a890e3029b05b32. Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:58:08.218228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 01 04:58:08.219021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application yield resource Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise self.value Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application session.commit() Sep 01 04:58:08.219973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.flush() Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application compat.raise_( Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:58:08.220868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 04:58:08.221827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:58:08.222624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [parameters: {'id': '7ad647b2a3b54e7e9a890e3029b05b32', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:08.223513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:08.224330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ad647b2a3b54e7e9a890e3029b05b32. Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:08.229685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 482/947] 10.222.0.43 () {60 vars in 1140 bytes} [Thu Sep 1 04:58:08 2022] POST /identity/v3/projects => generated 262 bytes in 184 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:08.230295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:08.318360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:08.341314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039666a1-aa89-4322-a8ba-bb466a6deb6d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:08.376617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:08.377280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:08.377558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:08.377828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:08.384765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:08.386421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-407753bf-b8d3-46ac-878d-adcd5c5b146a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:08.397776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:08.398687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:08.399757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 466/948] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:08.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:08.514914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5105be-6df5-45b5-9126-b07ea67a8ccb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:08.552002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:08.553026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:08.553534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:08.554068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:08.554929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:08.555455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:08.557846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2bde9f-0d93-424b-ac58-13488bf81351 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:08.568952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:08.585340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 483/949] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:08 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:08.778229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b74c9-0053-435e-a13a-532c653a1e5f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:08.778733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b74c9-0053-435e-a13a-532c653a1e5f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:08.778812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439b74c9-0053-435e-a13a-532c653a1e5f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:08.780102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 467/950] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:08.785489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bbe-4690-460a-9bc2-b6ccdbe8bed2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:08.785906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bbe-4690-460a-9bc2-b6ccdbe8bed2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:08.786084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d577bbe-4690-460a-9bc2-b6ccdbe8bed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:08.806402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0d577bbe-4690-460a-9bc2-b6ccdbe8bed2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:08.808502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d577bbe-4690-460a-9bc2-b6ccdbe8bed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:08.878198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 484/951] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:08 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:09.032743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c800-0ca6-4ddf-8889-9178f2dd7ec4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.033039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c800-0ca6-4ddf-8889-9178f2dd7ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.033327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a9c800-0ca6-4ddf-8889-9178f2dd7ec4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.034960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 468/952] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:09.040335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.040631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.040917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.061445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:09.062635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:09.130871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 485/953] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:09.153151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c800-0ca6-4ddf-8889-9178f2dd7ec4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.264510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a9c800-0ca6-4ddf-8889-9178f2dd7ec4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.299615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.300244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.300521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.300795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.301409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.302842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:09.312227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:09.313376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.314291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 469/954] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services/compute => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:09.319436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.382785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:09.420715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.426229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d43feb4-8f18-4ea9-afde-e733cc01867c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.427823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:09.466576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.467178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.467452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.467721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.468608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] RBAC: Adding query filter params (name=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:09.468906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.471207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.482105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 486/955] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:09.483630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.545864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7ac03b-99f7-4ca6-8cb1-3e3ea7d10797 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.582670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.583296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.583575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.583917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.584415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.585805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.590101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc3a593-d998-4f51-bc40-f48d056916cc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:09.595534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:09.596671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:09.597540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:09.601711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 470/956] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services/object-store => generated 93 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:09.602557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.619199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:09.633135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.634116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.634612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.635221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.636129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:09.636643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.638227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.649314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 487/957] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:09.681392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:09.725513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16941737-4f50-4980-9b4e-74334f5a4735 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.765240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.765948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.766229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.766509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.767225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:09.767534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.768992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153c069-c7ab-4536-84fe-cda29c0e874c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.775397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 471/958] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:09.782096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.871670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff7ab-a47d-4eeb-bd9b-ef12efe12b69 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.872190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff7ab-a47d-4eeb-bd9b-ef12efe12b69 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.872190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1ff7ab-a47d-4eeb-bd9b-ef12efe12b69 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.873799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 472/959] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:09.878913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.879196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.879473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.896623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58df4a-4a83-410a-afad-d056b458e132 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:09.898112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:09.899278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:09.956110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:09.956734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:09.957011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:09.957325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:09.957958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:09.958717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:09.960500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:09.967818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 488/960] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:09 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:09.973906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:09.989408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 473/961] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:09 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:10.035049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:10.086197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf44ff-76aa-4d54-a1ea-1bae6f1e944f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:10.122060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:10.122670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.122949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.123223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.123888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:10.125581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:10.149350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 489/962] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:09 2022] POST /identity/v3/endpoints => generated 349 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:10.260672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:10.328862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:10.370382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8d30fc-ae6e-41b4-b7ea-8ae629c74eb7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:10.410935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:10.411486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.411765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.412042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.423215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:10.427997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:10.429130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:10.430045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 474/963] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:10.435754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:10.540244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98bb163-391e-432d-b784-a80a08e5df95 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:10.547460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:10.576631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:10.577268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.577550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.577821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.578488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:10.578790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:10.580157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7633b02c-bcb5-41ec-8aac-fea92eb4ad11 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:10.590999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 490/964] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:10.596546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:10.687005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f56531-197c-47c5-af9f-8f3d5aaa0602 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.687181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f56531-197c-47c5-af9f-8f3d5aaa0602 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.687464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f56531-197c-47c5-af9f-8f3d5aaa0602 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.689047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 491/965] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:10.693899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.694182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.694457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.710659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eef3fc6-7dcf-485c-b8ed-07fc682316da None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:10.713117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:10.714406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:10.734010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:10.753038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:10.753700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.753979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.754254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.765833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:10.767313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:10.784342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:10.785354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:10.787504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:10.787504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:10.787504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:10.787504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 475/966] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:10.791211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:10.798778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 492/967] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:10 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:10.912792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c24d92-131b-4d94-aa68-f9b7434e0785 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:10.953942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:10.954553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:10.954834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:10.955108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:10.955751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:10.956055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:10.957437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:10.970203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 476/968] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:10.975762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.071874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.075442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1b330b-ed10-4262-95e9-e026ae1b6eb0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.097220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.110236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.110931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.111205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.111522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.118973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.121095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.129713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:11.133263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:11.136624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:11.137634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 493/969] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:58:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:11.141079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.227216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf818cd-5e5b-4150-a09a-0b667a1c29f2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.266136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9831fc-a031-4ef3-b853-ace2bb115473 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.274907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.276576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.276854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.277131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.278231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.280221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.283724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING keystone.server.flask.common [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 01 04:58:11.302372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.sql.core [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 04:58:11.302372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 04:58:11.302372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [parameters: {'user_id': 'e9d2200f2245439cbfc8c372c2e7834d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 04:58:11.302372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81632) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 01 04:58:11.310892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.311891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.312410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.312899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.313931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:11.314440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.316081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Sep 01 04:58:11.319482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:58:11.320405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application yield resource Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.rollback() Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.force_reraise() Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise self.value Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application session.commit() Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 01 04:58:11.323716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._prepare_impl() Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.flush() Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._flush(objects) Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application compat.raise_( Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application flush_context.execute() Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rec.execute(self) Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 01 04:58:11.328012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 01 04:58:11.331641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 01 04:58:11.333970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [parameters: {'user_id': 'e9d2200f2245439cbfc8c372c2e7834d', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:11.338572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 01 04:58:11.340486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 477/970] 10.222.0.43 () {60 vars in 1131 bytes} [Thu Sep 1 04:58:11 2022] POST /identity/v3/users => generated 160 bytes in 224 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:11.342679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.352678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 494/971] 10.222.0.43 () {56 vars in 1149 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:11.357261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.382492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.461662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.476397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2e09cd-5024-4561-a93a-252d2fd2f8ae None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.498262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb6e98c-de9f-45f7-b950-8dc2cc1aabfd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.520985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.521805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.522183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.522557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.533825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.535794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.542372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.543159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.543821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.544295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:11.550055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:11.551152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 01 04:58:11.552301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.554174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 478/972] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/users/cinder => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:11.562198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.638023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.640856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c8d5636-c934-4c0c-80dd-9aaaa149dcf9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.663500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.674707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073a5a29-9ad2-4a7b-8445-941e108cc5e2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.718950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.720387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.720843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.721587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.722294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:11.722706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.724026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.761389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 495/973] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 04:58:11.762930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b12ac-ee01-41ab-8cdd-f577127710da None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.763365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b12ac-ee01-41ab-8cdd-f577127710da None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.763804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250b12ac-ee01-41ab-8cdd-f577127710da None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.764364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 479/974] 10.222.0.43 () {56 vars in 1101 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:11.765210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:11.765697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 496/975] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:11.774839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.775122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.775427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.788813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:11.796563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:11.797992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:11.894626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae5850a-7ed9-4b31-a61f-7c4293dad069 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:11.905614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 497/976] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:11 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:11.934251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:11.934883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:11.935157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:11.935423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:11.951544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:11.953062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:11.970410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:11.971432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:11.972333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:11.972333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:11.972333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:11.974067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 480/977] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:11.980651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.030975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.086548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba342f-92a9-4ef3-b8ce-edcd094d39d9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.121057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.121686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.121970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.122239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.122874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:12.123173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.124514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7dd4c9-6e9d-4626-b3d2-9b70c57c03c8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.141310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 498/978] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:12.142278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.171068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928728aa-d93d-457b-8724-1b985d1acf8d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.171624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928728aa-d93d-457b-8724-1b985d1acf8d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.171624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928728aa-d93d-457b-8724-1b985d1acf8d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.172945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 499/979] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:12.173719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928728aa-d93d-457b-8724-1b985d1acf8d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.207889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.247792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20892622-ef8a-4f24-8db6-c976833ae7c5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.278487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928728aa-d93d-457b-8724-1b985d1acf8d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.280147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.280771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.281093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.281344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.285668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.288268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.289758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5fd50f6b-fda2-4031-b13f-8c3e527ae5a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:12.301977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:12.303041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:12.304135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 481/980] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:12.304723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.304820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.305075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.316683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.317319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.317599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.317870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.318515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.319863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.322404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:12.323896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:12.334136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 500/981] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:58:12 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:12.334928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.417210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 482/982] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:12 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:12.454298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6806b87c-b4b1-40ac-a220-792cd7e5d3e8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.493947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.494599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.494876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.495145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.495833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:12.496136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.497613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.510621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 501/983] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:12.516907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.569309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.621369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81776fd-fa1c-4e23-940a-d8e47d788574 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.655512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.656117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.656393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.656664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.657416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] RBAC: Adding query filter params (role.id=dfe4456f13104a5e9f802ed64ad8971f, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=a46db75abedb406987ba37de1bf81424) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:12.657726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.659142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.665108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 483/984] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:12 2022] GET /identity/v3/role_assignments?user.id=a46db75abedb406987ba37de1bf81424&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=dfe4456f13104a5e9f802ed64ad8971f => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:12.690054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.721631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:12.805710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c46e923-4032-4239-8281-7553c6660695 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.843012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:12.843711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:12.844091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:12.844367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:12.844943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:12.846355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:12.855484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:12.856673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:12.857673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 502/985] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:12.862903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:12.972729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41934559-9900-4630-90c4-aa8be1e5e619 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:12.986344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:13.009495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:13.010879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:13.011321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:13.011683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:13.012402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:13.012794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:13.014260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:13.020626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 484/986] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:13.025176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:13.117321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:13.128216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e51af9-1320-4f21-99e1-0607e4aee1ce None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:13.161717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:13.162454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:13.162828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:13.163194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:13.163912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:13.164304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:13.165788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:13.176241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 503/987] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:13.177310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:13.276068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b7c6a-dabc-4e43-8967-abd247436b6f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:13.309463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:13.310070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:13.310345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:13.310616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:13.311578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] RBAC: Adding query filter params (interface=admin, service_id=68a1ec04b14e48828dfd270bf1def90e, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:13.312001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:13.313432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62cacf-c696-465b-ae2a-e48615bcbaef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:13.323533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 485/988] 10.222.0.43 () {56 vars in 1249 bytes} [Thu Sep 1 04:58:13 2022] GET /identity/v3/endpoints?service_id=68a1ec04b14e48828dfd270bf1def90e&interface=admin®ion_id=RegionOne => generated 193 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:13.324723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:13.427902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad733712-002f-451f-a621-f800f6d8eb3e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:13.462453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:13.463813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:13.464092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:13.464364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:13.464967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:13.466416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c146ce5-6422-4a07-a94e-ccb220be9cac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:13.480601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 504/989] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:13 2022] GET /identity/v3/services => generated 1727 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 04:58:14.300145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407e0a-427a-46f3-8a35-14a05ab77fcd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:14.300648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407e0a-427a-46f3-8a35-14a05ab77fcd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:14.300648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c407e0a-427a-46f3-8a35-14a05ab77fcd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:14.302127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 486/990] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:14.308298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900fb-51be-4974-8626-be04c91b001f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:14.308751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900fb-51be-4974-8626-be04c91b001f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:14.308836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4900fb-51be-4974-8626-be04c91b001f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:14.328091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7f4900fb-51be-4974-8626-be04c91b001f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:14.329316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7f4900fb-51be-4974-8626-be04c91b001f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:14.345057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:14.407103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 505/991] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:14.650088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014f8-1376-4ff7-ae71-accc95b23dd6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:14.650472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014f8-1376-4ff7-ae71-accc95b23dd6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:14.650652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca014f8-1376-4ff7-ae71-accc95b23dd6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:14.652476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 487/992] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:14.657812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:14.658105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:14.658384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:14.677090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:14.677761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca014f8-1376-4ff7-ae71-accc95b23dd6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:14.678319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:14.731800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:14.758644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 506/993] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:14 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:14.802716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca014f8-1376-4ff7-ae71-accc95b23dd6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:14.837651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:14.838406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:14.838685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:14.838958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:14.839543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:14.840898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:14.849874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:14.851011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:14.851917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:14.855384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 488/994] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:14.857126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:14.940979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:14.970443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b19973d-2a37-4933-a543-80337876cbcd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.006350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.006963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.007242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.007514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.008145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] RBAC: Adding query filter params (name=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:15.008455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.009872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.019617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 507/995] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:15.020636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.048860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.131143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8d17e1-8bc3-432b-af26-39d531b95a54 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.134404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:15.153374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd1f8a7-7e2c-4f30-98dc-482c019eb0ca None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.168572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.169163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.169465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.169736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.170477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:15.170777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.172234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.177414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 489/996] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:15.183961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.189092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.189770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.190050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.190322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] PATH_INFO: `/v3/services/image` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.190904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.192316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:15.201492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:15.202680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:15.203568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 508/997] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services/image => generated 86 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:15.208391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.218407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:15.292642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008ea4a6-e7d2-4b32-931e-d366ff83dd2d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.317892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef1c923-3965-4188-8a15-be6a52141828 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.328452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.329063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.329375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.329649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.330349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] RBAC: Adding query filter params (interface=public, service_id=a52cc0a9c30e45bdbca8d195f70cbd75, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:15.330658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.332014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.336833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 490/998] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/endpoints?service_id=a52cc0a9c30e45bdbca8d195f70cbd75&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:15.342553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.362999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.363616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.363901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.364175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.364815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:15.365120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.367118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.372937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 509/999] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:15.378774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:15.386300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:15.458548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:15.461103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384e6847-0dcc-4240-8032-25a768f37746 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.489198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e103de0a-6afc-408e-a6b6-7f4a9b496e6d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:15.495399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.495997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.496268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.496539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.497133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.498502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2f7618-aecf-409b-b767-64a450a8e35e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.509238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 491/1000] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 04:58:15.509238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dca3-1116-4158-86ab-67ce77d07b63 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.509238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dca3-1116-4158-86ab-67ce77d07b63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.509238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b4dca3-1116-4158-86ab-67ce77d07b63 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.509238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 492/1001] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:15 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:15.514190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.514509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.514740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.531284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:15.531891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:15.532236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:15.532511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:15.533151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] RBAC: Adding query filter params (type=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:15.533484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:15.534875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:15.537070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:15.538572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:15.549869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 510/1002] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services?type=image => generated 122 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:15.629217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 493/1003] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:15 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:15.891335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:16.004792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b699fec-e4f2-4de0-ab85-f45bdb5ef48b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:16.039262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:16.039895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:16.040176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:16.040450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:16.041603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:16.043002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:16.044794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:16.053195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:16.054379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 01 04:58:16.055548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:16.058926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 511/1004] 10.222.0.43 () {56 vars in 1126 bytes} [Thu Sep 1 04:58:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:16.065214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:16.093084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:16.169546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcdf8cd-ecb2-4e03-9e3f-d92a28936235 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:16.203511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:16.204113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:16.204390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:16.204664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:16.205311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:16.205613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:16.206962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:16.216806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 494/1005] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:16.217957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:16.316505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649ceaa7-719b-470a-b80d-b2f6b025e40b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:16.349532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:16.350142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:16.350467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:16.350653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:16.351271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:16.351568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:16.352922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d710249-2dff-4ccc-ad01-16119fa773af None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:16.362542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 512/1006] 10.222.0.43 () {56 vars in 1122 bytes} [Thu Sep 1 04:58:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:16.363520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:16.453941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:16.465309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7674ab81-f997-4d97-91f6-4c5326bb7120 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:16.500175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:16.500925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:16.501144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:16.501463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:16.502136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:16.503478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b609a0-12c0-4c9e-893b-91aa78dfaf48 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:16.525213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 495/1007] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:17.450099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69896-447a-46f6-ab4c-faaf1ab22ea6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.450662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69896-447a-46f6-ab4c-faaf1ab22ea6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.450662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c69896-447a-46f6-ab4c-faaf1ab22ea6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.450986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28c2e-b87b-4c57-9ffa-164b2f2f9db5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.451402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28c2e-b87b-4c57-9ffa-164b2f2f9db5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.451580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e28c2e-b87b-4c57-9ffa-164b2f2f9db5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.452108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 513/1008] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:17.453136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 496/1009] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:17.457015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.457340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.457616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.457866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.458151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.458426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.476570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:17.477891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:17.482231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:17.483396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:17.538890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:17.557744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 514/1010] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:17.569475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 497/1011] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:17 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:17.828325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:17.828517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:17.915382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:17.936176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db2134d-c8ec-4caa-8f29-045bacd2d55f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:17.954141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34d752a-f4cd-48e4-a022-e15d5643b9a6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:17.976751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:17.977362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.977643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.977916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.979244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:17.980621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:17.990400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:17.990539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:17.991574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 01 04:58:17.994239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:17.995017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:17.995017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:17.995017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:17.995242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 498/1012] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:17 2022] GET /identity/v3/services/compute => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:17.995313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:17.995313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:17.997602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:18.017224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 515/1013] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:58:17 2022] POST /identity/v3/services => generated 242 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:18.117297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594382af-e3b4-4c8a-b431-2f465a318824 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:18.162514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:18.163386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:18.163814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:18.164244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:18.164897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:18.166495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:18.167236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:18.172400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 499/1014] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:17 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:18.178344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:18.231114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:18.285211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccca511b-25ca-4aef-abd5-1b7cfd0ec3f8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:18.320247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:18.320859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:18.321138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:18.321441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:18.322111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:18.322412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:18.323776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09361ea5-ff10-43b3-9927-8bb7d88165c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:18.328931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 516/1015] 10.222.0.43 () {56 vars in 1112 bytes} [Thu Sep 1 04:58:18 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:18.334842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:18.339213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:18.440161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a8154-879c-4f91-8357-1cfc18b8a52f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:18.471877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235a1e-269e-4e19-a77e-a4783d557b7d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:18.472852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235a1e-269e-4e19-a77e-a4783d557b7d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:18.473376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55235a1e-269e-4e19-a77e-a4783d557b7d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:18.474107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:18.474716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:18.474993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:18.475267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:18.475936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:18.476636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 517/1016] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:18 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:18.477328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:18.481893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:18.482178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:18.482459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:18.500542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 500/1017] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:18 2022] POST /identity/v3/endpoints => generated 334 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:58:18.505442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:18.505442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:18.589632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 518/1018] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:18 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:18.855743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:18.915924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:18.965745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c7f521-5552-41c5-9446-97b638440b46 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:19.000604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:19.001256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:19.001538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:19.001809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:19.003015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:19.004424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01de72fe-b327-4867-b659-fb22a74dcd38 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:19.006178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 501/1019] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:19.012278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:19.052574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:19.113621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68effee4-8feb-4785-abcb-17cb3b848721 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:19.150065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:19.150681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:19.150956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:19.151225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:19.151877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:19.153327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2e82f9-625a-4747-a71e-0cea11c9eef1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:19.189215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 519/1020] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:58:19 2022] POST /identity/v3/projects => generated 311 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:19.980116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ce7c-33ee-4a17-bddc-2ae06054b600 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:19.980627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ce7c-33ee-4a17-bddc-2ae06054b600 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:19.980704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503ce7c-33ee-4a17-bddc-2ae06054b600 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:19.982174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 502/1021] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:19.987445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:19.987863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:19.988040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.006744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:20.007933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:20.081281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 520/1022] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:19 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:20.356262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ce7c-33ee-4a17-bddc-2ae06054b600 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:20.459284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503ce7c-33ee-4a17-bddc-2ae06054b600 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:20.486055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.495467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40c2d38-147d-4221-8003-7898208063db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:20.496093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2d38-147d-4221-8003-7898208063db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.496371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2d38-147d-4221-8003-7898208063db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.496703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40c2d38-147d-4221-8003-7898208063db None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.497317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2d38-147d-4221-8003-7898208063db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:20.498699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40c2d38-147d-4221-8003-7898208063db None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a40c2d38-147d-4221-8003-7898208063db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:20.507900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:20.508887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:20.510113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:20.513510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 503/1023] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:20.515131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:20.536722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.538434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a47f9-2ddc-455f-b735-49a43d9b5be5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.538637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a47f9-2ddc-455f-b735-49a43d9b5be5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.538828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a47f9-2ddc-455f-b735-49a43d9b5be5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.541110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 504/1024] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:20.546954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.547321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.547806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.566727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:20.567943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:20.623225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2798a5-b6aa-4786-b195-1c81f6825575 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:20.643265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 505/1025] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:20 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:20.660341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:20.660957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.661276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.661610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.662242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:20.662559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:20.663951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:20.674093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 521/1026] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:20.675094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:20.775949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94aadc51-c074-4bf5-99f1-f4d19d6e01f6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:20.798792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.811606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:20.812216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.812498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.812774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.813435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:20.813805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:20.815176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:20.824988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 506/1027] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:20.826867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:20.910666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:20.914707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:20.930658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28eddad-c045-4bb6-9a16-b04b1e760ae4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:20.971225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:20.971871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:20.972151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:20.972424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:20.973133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] RBAC: Adding query filter params (interface=public, service_id=9ab1ef1879754dce84f4a927bbf83661, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:20.973471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:20.974834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:20.980977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 522/1028] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/endpoints?service_id=9ab1ef1879754dce84f4a927bbf83661&interface=public®ion_id=RegionOne => generated 194 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:20.986114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.028267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747382de-e87f-4231-aa00-8c728fe4af2e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.062962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.063593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.063873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.064266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.075017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:21.079851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:21.080825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:21.081754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 507/1029] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:21.086848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.093814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e74af-8ca0-4c99-ae02-e0e9e51c8285 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.129619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.130221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.130496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.130763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.131361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.132708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc412cee-ed75-44cb-a3e8-2ea0c86cae88 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.136318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.139860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 523/1030] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 04:58:20 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 04:58:21.141214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f423-ba07-48df-86fc-eb8a4482e801 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.141515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f423-ba07-48df-86fc-eb8a4482e801 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.141789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a5f423-ba07-48df-86fc-eb8a4482e801 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.143155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 524/1031] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:21.153322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.153641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.153880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.174273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:21.175520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:21.185021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.202903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06adbe83-f9a9-4db8-895a-225504f82fb2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.241897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.242707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.242988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.243649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.244613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:21.244920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.246877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.255016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 525/1032] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:21 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:21.260741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 508/1033] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:21.266634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.384242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e96404c-f511-473e-8a47-2ee83ea8c18b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.419072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.419755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.420037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.420307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.430485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.432694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.434398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:21.448218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:21.451114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:21.452044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:21.452044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:21.452044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:21.452044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 526/1034] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:21.455230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.531042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.560323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1513a-3255-42a2-9e39-6710ebeca850 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.569836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.597377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.597992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.598273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.598559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.599181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:21.599487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.600846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.619844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 509/1035] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:21.620879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.640150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e48d0-fc74-4cc7-a865-2c3c2c57a4a8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.673777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.674411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.674691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.674960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.676486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.677978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.679702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 527/1036] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:21.685653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.730759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac23243a-80e7-4f55-bd57-f3e9aee26888 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.747150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.768075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.768822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.769103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.769475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.777598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.779304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.787701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96bf47d-9ee1-4dbb-a54b-bbe750daf8eb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:21.791908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:21.792848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:21.798576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 510/1037] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/users/nova => generated 82 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:21.799199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:21.827842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.828445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.828722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.828990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.829671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.831092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.832938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:21.855452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 528/1038] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:58:21 2022] POST /identity/v3/users => generated 285 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:58:21.923514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c05c470-79fc-411d-8e94-da0ad9bbafe9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:21.962223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:21.963440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:21.963797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:21.964072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:21.964996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:21.965349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:21.966860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:21.991079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 511/1039] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:21.992312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:22.102326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e8c20f-d8e2-4027-8af7-ebd0a85d60d8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:22.120203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:22.139994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27801-4669-41ba-8739-bd611624854e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:22.140607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27801-4669-41ba-8739-bd611624854e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:22.140885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27801-4669-41ba-8739-bd611624854e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:22.141155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea27801-4669-41ba-8739-bd611624854e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:22.212829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea27801-4669-41ba-8739-bd611624854e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:22.214224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea27801-4669-41ba-8739-bd611624854e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:22.321461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 529/1040] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:21 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:22.322881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:22.413782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:22.430449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc45f05-373d-44e9-b0e9-9aff14a3a6aa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:22.464404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:22.465014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:22.465326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:22.465606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:22.475580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:22.477075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:22.492249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:22.494029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:22.495494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:22.495494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:22.495494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:22.497247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 512/1041] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:22.499835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27801-4669-41ba-8739-bd611624854e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:22.519314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:22.601940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea27801-4669-41ba-8739-bd611624854e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:22.636088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:22.636694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:22.636970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:22.637264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:22.637903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:22.638205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:22.639556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:22.654986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 530/1042] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:22.656468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:22.761038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f7c2b0-375f-4381-9551-faec9dd7a591 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:22.795886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:22.796516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:22.796795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:22.797069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:22.803707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:22.805142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:22.807436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:22.818421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:22.819532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:22.820654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:22.823003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 513/1043] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:22.828906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:22.909729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:22.933296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1df0-a8b3-41b9-a587-8489a30dc0bf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:22.973370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:22.973987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:22.974269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:22.974542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:22.975234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:22.975540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:22.977023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ffb8ea-de95-4d46-9c2c-5fef2baa160b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:22.989537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 531/1044] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:22.996023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:23.069115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c63e-a222-4c13-990c-6820cf59574d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.069463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c63e-a222-4c13-990c-6820cf59574d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.069626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5816c63e-a222-4c13-990c-6820cf59574d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.071253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 532/1045] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:23.077735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.078073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.078353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.098274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:23.099460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:23.102632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8e0969-9184-4ae9-b42c-0315c69416e0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:23.139141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:23.139741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.140013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.140280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.140991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] RBAC: Adding query filter params (role.id=dfe4456f13104a5e9f802ed64ad8971f, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:23.141361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:23.142864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:23.157234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 514/1046] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:22 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=dfe4456f13104a5e9f802ed64ad8971f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:23.177015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 533/1047] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:23.452376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:23.516352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:23.556556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10bad64f-4fe6-431d-8ddc-db704eee1176 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:23.592751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:23.593417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.593702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.593978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.594559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:23.595916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:23.605395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:23.606443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 01 04:58:23.607339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:23.609550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 515/1048] 10.222.0.43 () {56 vars in 1105 bytes} [Thu Sep 1 04:58:23 2022] GET /identity/v3/services/image => generated 86 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:23.612354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:23.678105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:23.713612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0055c2dc-14ad-4cd7-90da-2b408ca99d2d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:23.747657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:23.748273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.748555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.748829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.749749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:23.750054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:23.751418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3ec928-26cf-4235-8708-d602eb7c5d9b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:23.761153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 534/1049] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:23.762715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:23.852175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b52cf-cf51-4ea2-95e5-e523950eb52b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.852522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b52cf-cf51-4ea2-95e5-e523950eb52b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.853362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075b52cf-cf51-4ea2-95e5-e523950eb52b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.854838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 535/1050] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:23.859386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.859667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.859939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.866641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd99ab8-e4f7-4f9b-aa5c-56ae7ccfd370 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:23.878254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:23.879420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:23.897511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:23.908792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:23.909484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:23.909706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:23.909955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:23.910573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:23.910869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:23.912209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:23.922353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 516/1051] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:23.924268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:23.961300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 536/1052] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:23 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:24.030554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ddbaba-4369-4a8d-9eca-f973df636c92 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:24.063992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:24.064593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:24.064869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:24.065141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:24.065840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:24.067180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:24.090350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 517/1053] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 04:58:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 04:58:24.235559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:24.301454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:24.343222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877b6d7-a607-47f2-b743-8b99b1fd4bd1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:24.386689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:24.387323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:24.387601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:24.387871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:24.397949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:24.403193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:24.404166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:24.405020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 537/1054] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:24.411116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:24.458886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:24.515827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c53566-05e2-43e1-a569-4bac15c00aec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:24.549536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:24.550147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:24.550423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:24.550694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:24.551356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:24.551705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:24.553065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:24.561981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 518/1055] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:24.567596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:24.668463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb4bd44-fb17-4724-b075-a5f50e74b387 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:24.686162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:24.703681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:24.704363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:24.704642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:24.704910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] PATH_INFO: `/v3/users/794b104cb5994bef86373b241287ef73` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:24.718490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] RBAC: Authorizing `identity:get_user(user_id=794b104cb5994bef86373b241287ef73)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:24.719930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:24.721762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 538/1056] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:24 2022] GET /identity/v3/users/794b104cb5994bef86373b241287ef73 => generated 285 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:24.727423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:24.830446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d33fea-1951-4622-a17d-d72d62a64ea4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:24.839468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:24.865021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:24.865653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:24.865933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:24.866206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:24.938001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:24.939449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82207f7b-056c-4cd2-b6f7-b94d699de921 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:25.038355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 519/1057] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:25.044674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:25.045202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc43f-12eb-483f-83d5-f6932678fc24 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.045487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc43f-12eb-483f-83d5-f6932678fc24 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.045830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbc43f-12eb-483f-83d5-f6932678fc24 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.047251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 520/1058] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:25.051983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.052275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.052553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.075153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:25.076351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:25.078466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:25.146130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 521/1059] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:25.160615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aacd44-9c15-44bc-946a-fab666b2f95e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:25.194194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:25.194864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.195142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.195414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.197255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:25.198978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:25.205262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 539/1060] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:25.207424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:25.308874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbacfc39-cc91-4fcc-93d6-1063b831c6c6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:25.342531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:25.343124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.343397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.343663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.344375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=14af643608444571b7d5c80d61a6de26, user.id=794b104cb5994bef86373b241287ef73) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:25.344679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:25.346159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:25.357474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 522/1061] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/role_assignments?user.id=794b104cb5994bef86373b241287ef73&scope.project.id=14af643608444571b7d5c80d61a6de26&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:25.430584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:25.487244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:25.547213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca921e-d84d-4ef1-a5ee-cfe2718209a3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:25.581780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:25.582419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.582699 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.582971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.593342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:25.598172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:25.599109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:25.600093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 540/1062] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:25.605734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:25.611732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:25.718377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1c285c-761f-4403-b4ee-23eb586458a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:25.751597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:25.752261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.752543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.752814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.753504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:25.753812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:25.755170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:25.768311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 523/1063] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:25.769685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:25.871776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dae9d9d-7780-42e7-a406-3724414961da None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:25.874533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:25.908496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:25.909142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:25.909451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:25.909778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:25.920654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:25.922123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a77c543d-afb7-4078-9784-2b99cc33b96a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:25.938470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:25.939455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:25.940375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:25.940375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:25.940375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:25.941330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 541/1064] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:25.945947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.019451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.059980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df9e5-1665-4de9-91db-815e916dfe30 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.060361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df9e5-1665-4de9-91db-815e916dfe30 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.060933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140df9e5-1665-4de9-91db-815e916dfe30 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.063248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 542/1065] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:26.064375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660625aa-9aba-4b78-9a86-2b1fbdac5d71 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.067957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.068235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.068514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.088155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:26.089368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:26.104884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.105438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.105714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.105983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.106613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:26.106913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.108269 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.121032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 524/1066] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:26.126691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.163769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 543/1067] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:26 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:26.231258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe17d54-4d96-45c6-b908-1f1b592c9019 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.255086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.266174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.266795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.267074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.267350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.274350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.276272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:26.287817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:26.288788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:26.295433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 525/1068] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:26.297918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.387496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.405362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68725243-da61-445b-896f-1ea74a67f4dd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.437456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.443594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.444726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.445149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.445636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.446967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:26.447318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.448757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.471955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 544/1069] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:26.472997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.565053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517d0ffd-b7d5-440d-9e5d-976d594d615b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.574075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f36b202-2154-41a9-b604-b8e3b061b9a4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.604503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.605109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.605441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.605720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.610388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.611020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.611300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.611573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.622548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.623997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.627091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:26.640819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:26.641828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:26.642748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:26.642748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:26.642748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:26.642748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 545/1070] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:26.647612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.663367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.681121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.682602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.762751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4aa113-1cf5-4c3a-9cac-aa0d0a712dcc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.789234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 526/1071] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 04:58:26.793848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.799973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.800583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.800863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.801132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.801803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:26.802103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.803491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.819949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 546/1072] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:26.820756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.877143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.884910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:26.904657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752b124c-a0b8-4e34-8082-0e75eead616d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.926143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8ef82c-724c-4d16-a588-738f8510d7c1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:26.949757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.950403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.950683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.950958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.961503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.963490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.968861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:26.969552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:26.969811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:26.970484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:26.978562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:26.978691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:26.979574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:26.980484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:26.980484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:26.980484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:26.980656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:26.984622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 527/1073] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:26.985449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:26.993362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:26.994306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 547/1074] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:27.000896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:27.100161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192fa8f7-efe4-4dce-ab4d-bea6f05c67a1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:27.105517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c8b96d-05c8-4d59-b2c5-2d148183be93 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:27.123510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:27.137538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:27.138148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.138429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.138703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.139344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:27.139647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:27.140993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:27.143524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:27.144627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:27.145330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.145573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.145878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.146546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:27.146858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:27.148756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e7448e-da9f-4abf-9816-cf4fda0f68cf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:27.153755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 528/1075] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:27.179227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 548/1076] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:27.186490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:27.266056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e7991-983c-4680-aee3-d7693c42941e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.266424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e7991-983c-4680-aee3-d7693c42941e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.266612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3e7991-983c-4680-aee3-d7693c42941e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.268180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 549/1077] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:27.273868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.275147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.275728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.298951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:27.299219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41204ec-837f-443b-aa31-3cc7709d71b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:27.300458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:27.344694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:27.345033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.345351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.345622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/dfe4456f13104a5e9f802ed64ad8971f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.348151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=1c86910525fd489eae437f3cedc7443c, role_id=dfe4456f13104a5e9f802ed64ad8971f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:27.349741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:27.365037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 529/1078] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:58:27 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/1c86910525fd489eae437f3cedc7443c/roles/dfe4456f13104a5e9f802ed64ad8971f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:58:27.381625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 550/1079] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:27.652719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:27.708692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:27.752801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f204e3-2d3c-4011-8f6c-270d05a37767 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:27.785827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:27.786466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.786741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.787010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.796640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:27.801417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:27.802518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:27.803674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 530/1080] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:27.808933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:27.904395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4039321-94a9-4d6c-bff1-2d75c9edf9ee None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:27.911337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:27.940826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:27.941459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:27.941737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:27.942005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:27.942663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:27.943009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:27.944318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:27.953962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 551/1081] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:27.959745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:28.064328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af48b500-e814-470a-924f-fb1ebd2dd51e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:28.080390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:28.098502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:28.099188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:28.099464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:28.099761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] PATH_INFO: `/v3/users/794b104cb5994bef86373b241287ef73` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:28.100861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] RBAC: Authorizing `identity:get_user(user_id=794b104cb5994bef86373b241287ef73)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:28.102302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:28.103933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 531/1082] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:27 2022] GET /identity/v3/users/794b104cb5994bef86373b241287ef73 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:28.109679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:28.205608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a44ae-2233-4f27-a2de-5e0e45a3fc79 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:28.238193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:28.238807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:28.239081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:28.239349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:28.240442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:28.241895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bf3281-01de-4122-8674-b17df82735cc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:28.243635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 552/1083] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:28 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:28.249811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:28.351204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b9e135-22fb-4c37-82eb-272b6e6ff943 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:28.384625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:28.385314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:28.385595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:28.385871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26/users/794b104cb5994bef86373b241287ef73/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:28.387754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] RBAC: Authorizing `identity:create_grant(project_id=14af643608444571b7d5c80d61a6de26, user_id=794b104cb5994bef86373b241287ef73, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:28.389168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24a97183-7815-439c-8af8-674ebd8b7171 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:28.402473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 532/1084] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:58:28 2022] PUT /identity/v3/projects/14af643608444571b7d5c80d61a6de26/users/794b104cb5994bef86373b241287ef73/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:58:29.253073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3521-6ce0-4085-b877-33d206169835 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:29.253663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3521-6ce0-4085-b877-33d206169835 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:29.253663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5d3521-6ce0-4085-b877-33d206169835 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:29.254900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 553/1085] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:29.260744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:29.261145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:29.261318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:29.279659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:29.280823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:29.319445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:29.347432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 533/1086] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:29.614058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3521-6ce0-4085-b877-33d206169835 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:29.649724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:29.713999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5d3521-6ce0-4085-b877-33d206169835 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:29.746279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:29.746900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:29.747173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:29.747441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:29.758277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:29.763008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:29.763977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:29.764838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 554/1087] 10.222.0.43 () {56 vars in 1120 bytes} [Thu Sep 1 04:58:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:29.770144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:29.865905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8230daf3-866f-483e-a4c1-2d5a60ace2e1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:29.899934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:29.900534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:29.900810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:29.901079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:29.901759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:29.902057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:29.903398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:29.911194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 534/1088] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:58:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:29.916961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.014736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.020985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e055c-5087-4534-a2a3-d7cd229d3d62 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.053808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.054431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.054707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.054976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.066369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.067785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:30.084431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:30.085645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:30.087337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:30.087337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:30.087337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:30.087337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 555/1089] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:30.092092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.126828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.191094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe35c64-d867-4d33-bb1a-a80d6735eec9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.223931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.224532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.224809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.225084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.225757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:30.226061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.227988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db4f9e77-957b-49d2-957e-e9e60ef4968c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.239176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 535/1090] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:30.245397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.292354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37f53f-421c-47bf-bfa7-21b4571d25f4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.292902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37f53f-421c-47bf-bfa7-21b4571d25f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.292902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af37f53f-421c-47bf-bfa7-21b4571d25f4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.294267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 536/1091] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:58:30.299198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.299477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.299751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.317598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:30.318767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:30.348208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c713abf-b12c-4a0b-989e-d622fa304558 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.383419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.384128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 537/1092] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:58:30.384498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.384797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.385064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.392444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.393894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 04:58:30.405107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:30.406071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:30.407511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 556/1093] 10.222.0.43 () {56 vars in 1093 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:30.411892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.438085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.508252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af25e4f0-2f30-4214-aba1-c7548c13a989 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.541060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.541681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.541961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.542236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.542958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:30.543263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.544679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.561614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 538/1094] 10.222.0.43 () {56 vars in 1133 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:30.567102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.578881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.657920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.667867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084619b6-3a27-4764-a0d5-1a5e3ef69ed3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.701535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.702141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.702421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.702695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.740948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.757245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62b35c0-668a-483c-ab49-d6442e82c247 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.769213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.770665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.780658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.792317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.792941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.793248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.793520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.803450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:30.808175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:30.809292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:30.810400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 539/1095] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:58:30.815168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.870096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 557/1096] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:30.875969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.914054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bb1407-7ea8-4529-9aea-084eb95b1715 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.948792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:30.948936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:30.949238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:30.949509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:30.950166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:30.950462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:30.951809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:30.959877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 540/1097] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:30.966156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:30.974299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:30.979381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49624ad-d8a2-4619-ac68-bb9021235611 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:30.988614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.013828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.014446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.014721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.014994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.025307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.026790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:58:31.042482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:31.043438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 04:58:31.044383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:58:31.044383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 04:58:31.044383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:31.044383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 558/1098] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:31.049153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.069304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c266845-22fe-4a72-8eb9-21049c88759e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.101066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.101705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.101979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.102793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] PATH_INFO: `/v3/users/794b104cb5994bef86373b241287ef73` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.104004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] RBAC: Authorizing `identity:get_user(user_id=794b104cb5994bef86373b241287ef73)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.105430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.106990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 541/1099] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:30 2022] GET /identity/v3/users/794b104cb5994bef86373b241287ef73 => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:31.112690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.148393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64f38d0-858d-45cf-9790-cd0d816b9c7a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.182208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.182772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.183056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.183325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.184018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:31.184324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.185776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.188637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.197861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 559/1100] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:31.203411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.215276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b14bde-7a8d-4db4-ad85-ad0af93f015e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.224199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.250313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.250926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.251204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.251478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.300747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88851d57-8bec-4d60-957e-47d9fd03a302 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.317341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.318776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.334166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.334787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.335068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.335346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.341962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.343457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 04:58:31.354510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:31.355806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:31.356740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 560/1101] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:31.361429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.390302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.421286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 542/1102] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 04:58:31.427124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.445442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.466270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af0215e-2b98-489a-bdf1-cf6432a4d1b0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.499923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.500517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.500794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.501070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.501772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:31.502073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.503489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.515297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 561/1103] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:31.521365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.525549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ee9bc-4b1a-4837-90ff-7cdf7a740201 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.559241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.559858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.560135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.560411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.561536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.562941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.564549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 543/1104] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:31.570535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:31.614128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:31.619751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390d7bc8-b084-43e9-82f5-86e091507421 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.654088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.654678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.654951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.655217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.655933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] RBAC: Adding query filter params (role.id=dfe4456f13104a5e9f802ed64ad8971f, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=1c86910525fd489eae437f3cedc7443c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:31.656235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.657717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222cc68c-d0ac-4bf8-992b-f161d0940a31 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.663231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 562/1105] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/role_assignments?user.id=1c86910525fd489eae437f3cedc7443c&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=dfe4456f13104a5e9f802ed64ad8971f => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:31.675747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e77502d-c1d2-444d-9481-d10ec1199350 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:31.713127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:31.713697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:31.713975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:31.714245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:31.714992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=14af643608444571b7d5c80d61a6de26, user.id=794b104cb5994bef86373b241287ef73) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:31.715308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:31.716764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec12c25-6b99-4f44-97d9-95eceb363439 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:31.723540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 544/1106] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:31 2022] GET /identity/v3/role_assignments?user.id=794b104cb5994bef86373b241287ef73&scope.project.id=14af643608444571b7d5c80d61a6de26&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:33.675971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1918d9-a14f-46e0-b5bd-2023d7acb514 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:33.676498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1918d9-a14f-46e0-b5bd-2023d7acb514 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:33.676498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1918d9-a14f-46e0-b5bd-2023d7acb514 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:33.677916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 563/1107] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:33.682966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:33.683462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:33.683588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:33.702176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:33.703354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:33.768684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 545/1108] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:34.038596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1918d9-a14f-46e0-b5bd-2023d7acb514 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:34.042991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:34.138385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1918d9-a14f-46e0-b5bd-2023d7acb514 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:34.171418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:34.172029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:34.172306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:34.172575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:34.173690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:34.175102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00780d6-d123-45f3-92f6-65e8340be04c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:34.176669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 564/1109] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:34.183203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:34.217108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:34.278696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c20b56c-8ac9-4cbc-aae2-572a34b31db1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:34.314896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:34.315507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:34.315791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:34.316070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:34.316724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:34.318174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4c34e4-775c-4139-955d-ac5b07f95fb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:34.339163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 546/1110] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:58:34 2022] POST /identity/v3/users => generated 286 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:36.302819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b915b-2787-402a-a03e-91f5dffe0933 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:36.303379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b915b-2787-402a-a03e-91f5dffe0933 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:36.303379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-549b915b-2787-402a-a03e-91f5dffe0933 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:36.304626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 565/1111] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:36.310522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:36.310959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:36.311082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:36.329120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:36.330323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:36.394720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 547/1112] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:36.662055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b915b-2787-402a-a03e-91f5dffe0933 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:36.731095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:36.761114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-549b915b-2787-402a-a03e-91f5dffe0933 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:36.794201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:36.794830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:36.795110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:36.795380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] PATH_INFO: `/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:36.796755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] RBAC: Authorizing `identity:get_role(role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:36.798135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:36.799442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 566/1113] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:36 2022] GET /identity/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:36.805965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:36.829375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:36.901888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f528f6-1784-43c2-98e7-546ee24932e6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:36.935046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:36.935618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:36.935898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:36.936171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] PATH_INFO: `/v3/users/edf71ef4b4ae440994fd5393fac72217` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:36.949979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] RBAC: Authorizing `identity:get_user(user_id=edf71ef4b4ae440994fd5393fac72217)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:36.951403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:36.953021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 548/1114] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:36 2022] GET /identity/v3/users/edf71ef4b4ae440994fd5393fac72217 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:36.958807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:37.055766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb585ef-e80b-4b54-8995-88d294854e4e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:37.087604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:37.088187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:37.088467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:37.088740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:37.098576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:37.153469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:37.154905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:37.249027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 567/1115] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:37.254889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:37.333601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:37.352851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e80e2c4-25b0-4820-bfd2-e64068a75ed3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:37.386122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:37.386734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:37.387012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:37.387283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:37.388373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:37.389810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c2f803-1cbb-4608-9ae5-3ddd70c8d484 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:37.391431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 549/1116] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:37 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:37.397534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:37.438946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:37.495282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e92f0a-7d4c-4207-8f4d-6628bf530a8f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:37.528503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:37.529043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:37.529353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:37.529627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:37.530352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=14af643608444571b7d5c80d61a6de26, user.id=edf71ef4b4ae440994fd5393fac72217) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:37.530662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:37.532089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950540c9-e224-4892-9b23-ea71567e83f4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:37.537394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 568/1117] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:37 2022] GET /identity/v3/role_assignments?user.id=edf71ef4b4ae440994fd5393fac72217&scope.project.id=14af643608444571b7d5c80d61a6de26&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:39.439046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a937ef-b211-49e1-92d0-4cf814d16d7f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:39.439597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a937ef-b211-49e1-92d0-4cf814d16d7f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:39.439597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a937ef-b211-49e1-92d0-4cf814d16d7f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:39.440915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 550/1118] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:39.446810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:39.447233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:39.447334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:39.465559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:39.466720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:39.530461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 569/1119] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:39.799536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a937ef-b211-49e1-92d0-4cf814d16d7f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:39.896708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a937ef-b211-49e1-92d0-4cf814d16d7f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:39.929623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:39.930389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:39.930666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:39.930936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] PATH_INFO: `/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:39.932329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] RBAC: Authorizing `identity:get_role(role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:39.933716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:39.935019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 551/1120] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:39 2022] GET /identity/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:39.940750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:39.973297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:40.038467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591d73ee-d4ab-48bb-9801-9989620b6105 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:40.072080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:40.072639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:40.072919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:40.073205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] PATH_INFO: `/v3/users/edf71ef4b4ae440994fd5393fac72217` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:40.074331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] RBAC: Authorizing `identity:get_user(user_id=edf71ef4b4ae440994fd5393fac72217)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:40.075751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:40.077346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 570/1121] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:39 2022] GET /identity/v3/users/edf71ef4b4ae440994fd5393fac72217 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:40.083155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:40.100902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:40.181930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f2a677-4c6b-47a9-9162-19ce0d61e928 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:40.214870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:40.215493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:40.215774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:40.216051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:40.217161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:40.218618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ab47a5-3b66-4c6c-a740-e15c3cbd4544 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:40.220240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 552/1122] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:40 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:40.226340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:40.321647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8201b5f-a9c0-4b62-a7b7-ee48d2f59496 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:40.323177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:40.355686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:40.356329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:40.356605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:40.356871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26/users/edf71ef4b4ae440994fd5393fac72217/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:40.358961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] RBAC: Authorizing `identity:create_grant(project_id=14af643608444571b7d5c80d61a6de26, user_id=edf71ef4b4ae440994fd5393fac72217, role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:40.360379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00a70937-9c54-4cec-91ec-e2ce45c09010 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:40.373238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 571/1123] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:58:40 2022] PUT /identity/v3/projects/14af643608444571b7d5c80d61a6de26/users/edf71ef4b4ae440994fd5393fac72217/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:58:42.248748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c759-6589-4e12-b942-4e9a918e6c42 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:42.249315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c759-6589-4e12-b942-4e9a918e6c42 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:42.249315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7624c759-6589-4e12-b942-4e9a918e6c42 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:42.250563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 553/1124] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:42.255758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:42.256152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:42.256297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:42.273973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:42.275205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:42.340420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 572/1125] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:42.613034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624c759-6589-4e12-b942-4e9a918e6c42 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:42.694480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:42.711642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7624c759-6589-4e12-b942-4e9a918e6c42 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:42.743526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:42.744130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:42.744403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:42.744672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] PATH_INFO: `/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:42.746049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] RBAC: Authorizing `identity:get_role(role_id=d2db991fda544cf1b3ebc674fe6ec60d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:42.747394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:42.748945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 554/1126] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:42 2022] GET /identity/v3/roles/d2db991fda544cf1b3ebc674fe6ec60d => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:42.754623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:42.841053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:42.850770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6bd3178-9fd6-467d-bf15-9d0e247dd04a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:42.883816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:42.884372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:42.884647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:42.885178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] PATH_INFO: `/v3/users/edf71ef4b4ae440994fd5393fac72217` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:42.886305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] RBAC: Authorizing `identity:get_user(user_id=edf71ef4b4ae440994fd5393fac72217)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:42.887718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:42.889272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 573/1127] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:42 2022] GET /identity/v3/users/edf71ef4b4ae440994fd5393fac72217 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:42.894886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:42.991285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ba1d0-b261-456b-81cb-3aa29d56cf76 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:43.024806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:43.025420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:43.025698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:43.025969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:43.045787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:43.089815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:43.091234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:43.186032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 555/1128] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:42 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:43.191836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:43.287496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db658ee3-3b16-4015-8ecb-e8a254a2de60 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:43.321274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:43.321795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:43.322071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:43.322339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] PATH_INFO: `/v3/projects/14af643608444571b7d5c80d61a6de26` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:43.323434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] RBAC: Authorizing `identity:get_project(project_id=14af643608444571b7d5c80d61a6de26)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:43.324846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39926c75-a97e-4dca-996f-1854ff63a766 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:43.326462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 574/1129] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:43 2022] GET /identity/v3/projects/14af643608444571b7d5c80d61a6de26 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:43.332416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:43.384455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:43.430702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809907d1-de85-4053-b1bc-fb220b04c024 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:43.464768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:43.465328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:43.465610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:43.465886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:43.466624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] RBAC: Adding query filter params (role.id=d2db991fda544cf1b3ebc674fe6ec60d, scope.project.id=14af643608444571b7d5c80d61a6de26, user.id=edf71ef4b4ae440994fd5393fac72217) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:43.466915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:43.468330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f383fe50-c1cb-49d8-b411-139907fdad70 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:43.473914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 556/1130] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:43 2022] GET /identity/v3/role_assignments?user.id=edf71ef4b4ae440994fd5393fac72217&scope.project.id=14af643608444571b7d5c80d61a6de26&role.id=d2db991fda544cf1b3ebc674fe6ec60d => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:45.393537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176553eb-b76b-4379-b05d-ccabebb00945 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:45.394090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176553eb-b76b-4379-b05d-ccabebb00945 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:45.394090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176553eb-b76b-4379-b05d-ccabebb00945 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:45.395418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 575/1131] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:45.401077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:45.401538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:45.401652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:45.420727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:45.421944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:45.488815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 557/1132] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:45.753503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176553eb-b76b-4379-b05d-ccabebb00945 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:45.780930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:45.850650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176553eb-b76b-4379-b05d-ccabebb00945 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:45.884021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:45.884633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:45.884909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:45.885199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:45.886294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:45.887704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f02bc46f-0180-4cc6-a3e5-997df94d84f1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:45.889255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 576/1133] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:45.894979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:45.940275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:45.992838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2e6a24-ebb2-43e7-aa37-7e81b0c622dc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:46.025287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:46.025823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:46.026102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:46.026374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:46.027018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:46.028436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a2a4b-e9df-4a8d-961c-12b9aeea4414 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:46.054031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 558/1134] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:58:45 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:47.964013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a66aa-fea2-4f9d-b1d1-75ab8ca2d24c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:47.964424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a66aa-fea2-4f9d-b1d1-75ab8ca2d24c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:47.964564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a66aa-fea2-4f9d-b1d1-75ab8ca2d24c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:47.965951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 577/1135] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:47.971115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:47.971500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:47.971661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:47.989281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:47.990441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:48.055303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 559/1136] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:48.323738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a66aa-fea2-4f9d-b1d1-75ab8ca2d24c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:48.416797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:48.423983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a66aa-fea2-4f9d-b1d1-75ab8ca2d24c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:48.459935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:48.460561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:48.460838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:48.461114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:48.462303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:48.463729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137030d-f3f8-4da5-93c8-04aef99915c7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:48.465560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 578/1137] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 04:58:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:48.471301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:48.499193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:48.568358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa0388f-7a57-46ba-b611-c310ec0663e9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:48.601093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:48.601793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:48.602074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:48.602350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:48.603000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:48.604413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5a6b38-7545-43c4-9cf2-01d50a5c98cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:48.625386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 560/1138] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:58:48 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:58:50.557595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de6a0-2eef-4e7c-a209-12c4dade428c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:50.558122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de6a0-2eef-4e7c-a209-12c4dade428c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:50.558122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887de6a0-2eef-4e7c-a209-12c4dade428c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:50.559498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 579/1139] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:50.564653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:50.565040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:50.565218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:50.583401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:50.584564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:50.647383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 561/1140] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:50.918815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887de6a0-2eef-4e7c-a209-12c4dade428c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.016609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887de6a0-2eef-4e7c-a209-12c4dade428c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.050356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.050968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.051242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.051507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.061278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:51.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:51.067159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:51.068258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 580/1141] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:51.073649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.088668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.169812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986ee51e-eee4-4fe8-8a16-dae985ae2d90 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.201755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.202338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.202618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.202888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.203536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:51.203833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:51.205173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:51.212740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 562/1142] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 04:58:51.218419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.244045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.315936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d6e031-1548-4815-9565-9cfdfedcc730 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.348132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.348740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.349017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.349316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] PATH_INFO: `/v3/users/b051a61f7f94496790575a8bea78857e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.362176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] RBAC: Authorizing `identity:get_user(user_id=b051a61f7f94496790575a8bea78857e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:51.363597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:51.365164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 581/1143] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:51 2022] GET /identity/v3/users/b051a61f7f94496790575a8bea78857e => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:51.371633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.446449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.470836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9e2138-e9f4-4be4-8665-32c5a7f03276 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.505209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.505822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.506097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.506367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.570537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:51.572052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:51.642475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.664885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 563/1144] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:51.670798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.750951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:51.768258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe88ee5-5c78-41cb-9f9e-fdd65c210abd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.801339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.801953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.802232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.802504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] PATH_INFO: `/v3/projects/c2583e227b284fa8909320ac73cca622` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.803597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] RBAC: Authorizing `identity:get_project(project_id=c2583e227b284fa8909320ac73cca622)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:51.805046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec17b7a-0976-47c4-ba00-a23d4d4a6891 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:51.806684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 582/1145] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:51 2022] GET /identity/v3/projects/c2583e227b284fa8909320ac73cca622 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:51.812904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:51.907264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b14de5-70af-42e1-83cd-e5697616a3eb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:51.938739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:51.939325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:51.939600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:51.939868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:51.940578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=c2583e227b284fa8909320ac73cca622, user.id=b051a61f7f94496790575a8bea78857e) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:51.940883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:51.942307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0e3f9-4234-4b2d-8e05-15d037be524d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:51.948562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 564/1146] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:51 2022] GET /identity/v3/role_assignments?user.id=b051a61f7f94496790575a8bea78857e&scope.project.id=c2583e227b284fa8909320ac73cca622&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:53.801639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899febbe-4174-4f1a-9702-35f330f01d9e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:53.802200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899febbe-4174-4f1a-9702-35f330f01d9e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:53.802200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899febbe-4174-4f1a-9702-35f330f01d9e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:53.803494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 583/1147] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:53.809305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:53.809675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:53.809853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:53.828296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:53.829479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:53.861626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:53.894918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 565/1148] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:54.160349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899febbe-4174-4f1a-9702-35f330f01d9e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:54.257797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899febbe-4174-4f1a-9702-35f330f01d9e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:54.291289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:54.291932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:54.292208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:54.292473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:54.302218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:54.307865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:54.308968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:58:54.310241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 584/1149] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:54.314840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:54.409195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f976d6-1dae-448b-b040-2f826d438b33 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:54.442320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:54.442851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:54.443131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:54.443404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:54.444063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:54.444367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:54.445778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:54.453454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 566/1150] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:54.459030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:54.472540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:54.557112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804329b5-d9e8-4e63-9ea7-222993300b5f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:54.589336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:54.589951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:54.590224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:54.590489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] PATH_INFO: `/v3/users/b051a61f7f94496790575a8bea78857e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:54.591581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] RBAC: Authorizing `identity:get_user(user_id=b051a61f7f94496790575a8bea78857e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:54.592993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:54.594577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 585/1151] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:54 2022] GET /identity/v3/users/b051a61f7f94496790575a8bea78857e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:54.600517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:54.632818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:54.699603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40bf084b-ba79-495c-b681-fe183146bb44 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:54.732310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:54.732928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:54.733229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:54.733509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] PATH_INFO: `/v3/projects/c2583e227b284fa8909320ac73cca622` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:54.734638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] RBAC: Authorizing `identity:get_project(project_id=c2583e227b284fa8909320ac73cca622)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:54.736045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0f2029-8b81-46cd-8cf0-7b33f885c622 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:54.737684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 567/1152] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:54 2022] GET /identity/v3/projects/c2583e227b284fa8909320ac73cca622 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:54.743569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:54.817923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:54.839748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd4ffd4-1c1e-48f1-b1dc-0e179ac9d8e5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:54.871164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:54.871800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:54.872078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:54.872349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] PATH_INFO: `/v3/projects/c2583e227b284fa8909320ac73cca622/users/b051a61f7f94496790575a8bea78857e/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:54.874482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2583e227b284fa8909320ac73cca622, user_id=b051a61f7f94496790575a8bea78857e, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:54.875895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f20461b-f73d-4d07-abed-e60431764161 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:54.888935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 586/1153] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:58:54 2022] PUT /identity/v3/projects/c2583e227b284fa8909320ac73cca622/users/b051a61f7f94496790575a8bea78857e/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:58:56.768281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34423a9-e0c8-4a87-85bc-4a89fff39aa6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:56.768873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34423a9-e0c8-4a87-85bc-4a89fff39aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:56.768873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34423a9-e0c8-4a87-85bc-4a89fff39aa6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:56.770203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 568/1154] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:58:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:58:56.775489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:56.775908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:56.776037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:56.793762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:58:56.794913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:58:56.859689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 587/1155] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:58:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:58:57.126128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34423a9-e0c8-4a87-85bc-4a89fff39aa6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:57.219475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:57.223653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34423a9-e0c8-4a87-85bc-4a89fff39aa6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:57.254902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:57.255503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:57.255777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:57.256047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:57.266683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:58:57.271359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:58:57.273023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:58:57.274211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 569/1156] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:58:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:58:57.279080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:57.343748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:57.376900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9eb3e-cb6e-43fe-8e12-4d2367197090 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:57.408391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:57.408993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:57.409307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:57.409607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:57.410264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:57.410565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:57.411914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:57.420034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 588/1157] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:58:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:57.425949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:57.521334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a5d2c-3e48-477d-99f7-ae7724b095b6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:57.553658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:57.555273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:57.555273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:57.555273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] PATH_INFO: `/v3/users/b051a61f7f94496790575a8bea78857e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:57.556160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] RBAC: Authorizing `identity:get_user(user_id=b051a61f7f94496790575a8bea78857e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:57.557656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:57.559273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 570/1158] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:58:57 2022] GET /identity/v3/users/b051a61f7f94496790575a8bea78857e => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:57.565239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:57.662578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d575e1-0459-42cb-aa56-3157025f1c95 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:57.689332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:57.695755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:57.696348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:57.696628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:57.696902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:57.762373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:57.763804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:57.859321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 589/1159] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:58:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:58:57.865308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:57.893467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:57.963122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02c8647-a6ea-48f5-b2ac-1aae494e5db6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:57.994836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:57.995446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:57.995723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:57.995998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] PATH_INFO: `/v3/projects/c2583e227b284fa8909320ac73cca622` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:57.997091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] RBAC: Authorizing `identity:get_project(project_id=c2583e227b284fa8909320ac73cca622)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:57.998790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec557fc-afa1-4fe0-9e54-4d032306e236 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:58.000388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 571/1160] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:58:57 2022] GET /identity/v3/projects/c2583e227b284fa8909320ac73cca622 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:58:58.006527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:58:58.035736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:58:58.102178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d51d720-4e29-444f-9b9c-1bf119ebd274 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:58:58.134623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:58:58.135215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:58:58.135495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:58:58.135764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:58:58.136479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=c2583e227b284fa8909320ac73cca622, user.id=b051a61f7f94496790575a8bea78857e) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:58:58.136783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:58:58.138226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f81464f-3191-4388-be07-75e5bbc3e1a6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:58:58.143702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 590/1161] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:58:58 2022] GET /identity/v3/role_assignments?user.id=b051a61f7f94496790575a8bea78857e&scope.project.id=c2583e227b284fa8909320ac73cca622&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:00.072700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f556-01c4-42f9-b6ce-b6a18998935c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:00.073258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f556-01c4-42f9-b6ce-b6a18998935c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:00.073258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d04f556-01c4-42f9-b6ce-b6a18998935c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:00.074596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 572/1162] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:00.079754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:00.080160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:00.080299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:00.098045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:00.099215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:00.163932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 591/1163] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:00.427057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f556-01c4-42f9-b6ce-b6a18998935c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:00.520620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:00.528403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d04f556-01c4-42f9-b6ce-b6a18998935c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:00.560845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:00.561465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:00.561748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:00.562022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:00.627687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:00.629114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:00.722162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:00.728556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 573/1164] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:59:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:59:00.734473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:00.759162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:00.832523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5ba45e-d927-4537-a2bc-42856d14886b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:00.865344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:00.866037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:00.866827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:00.867101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:00.873820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:00.875248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9ef77978-b5d5-470e-8ec6-964134a35ac8 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:59:00.886324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:59:00.887561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:59:00.888648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 592/1165] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 04:59:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:59:00.893377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:00.989413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6550b897-ad28-49d1-8c52-aea2854f089b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:01.023148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:01.023742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:01.024024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:01.024294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:01.024928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:01.025253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:01.026609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f9c3d6-1280-47ef-80fd-036e07ea537e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:01.033412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 574/1166] 10.222.0.43 () {56 vars in 1115 bytes} [Thu Sep 1 04:59:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:02.912144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac91c-5c46-4a61-a696-1a3b2d73f9b9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:02.912717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac91c-5c46-4a61-a696-1a3b2d73f9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:02.912717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ac91c-5c46-4a61-a696-1a3b2d73f9b9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:02.914119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 593/1167] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:02.919728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4163c5-0221-46b6-a5cc-206964ea3009 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:02.920140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4163c5-0221-46b6-a5cc-206964ea3009 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:02.920258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4163c5-0221-46b6-a5cc-206964ea3009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:02.937929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fd4163c5-0221-46b6-a5cc-206964ea3009 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:02.939094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fd4163c5-0221-46b6-a5cc-206964ea3009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:02.992450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:03.004450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 575/1168] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:03.271144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ac91c-5c46-4a61-a696-1a3b2d73f9b9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:03.354696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:03.370694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ac91c-5c46-4a61-a696-1a3b2d73f9b9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:03.403485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:03.404077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:03.404357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:03.404630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:03.405319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:03.406687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3eeb896-46aa-4d0f-952e-32e306606f4a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:03.421294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 594/1169] 10.222.0.43 () {60 vars in 1138 bytes} [Thu Sep 1 04:59:03 2022] POST /identity/v3/domains => generated 267 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:59:05.351924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ae9-db77-4ebe-b5a5-46c0cf6994f0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:05.352424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ae9-db77-4ebe-b5a5-46c0cf6994f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:05.352424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad901ae9-db77-4ebe-b5a5-46c0cf6994f0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:05.353863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 576/1170] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:05.359022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:05.359439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:05.359575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:05.379892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:05.381089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:05.448366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 595/1171] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:05.716975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901ae9-db77-4ebe-b5a5-46c0cf6994f0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:05.816731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad901ae9-db77-4ebe-b5a5-46c0cf6994f0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:05.848899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:05.849533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:05.849808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:05.850077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] PATH_INFO: `/v3/domains/4c4d6b71a67642689f548ade9a367d48` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:05.859892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c4d6b71a67642689f548ade9a367d48)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:05.861341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d99d1730-f996-4ad1-b5ba-bde8daf7a5ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:05.862893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 577/1172] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Sep 1 04:59:05 2022] GET /identity/v3/domains/4c4d6b71a67642689f548ade9a367d48 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:05.869277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:05.940433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:05.966590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd367568-928f-4554-92ec-bc5245bb895b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:05.999752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:06.000300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:06.000581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:06.000856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:06.001526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:06.002953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ead4140-cfd6-41ba-b03a-de8537f2c5f5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:06.028145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 596/1173] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 04:59:05 2022] POST /identity/v3/projects => generated 361 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:59:07.938419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fb837-e0cf-4d6d-9813-5b7d39c6da99 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:07.938991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fb837-e0cf-4d6d-9813-5b7d39c6da99 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:07.938991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570fb837-e0cf-4d6d-9813-5b7d39c6da99 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:07.940278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 578/1174] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:07.946206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:07.946723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:07.946723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:07.964555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:07.965761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:08.030121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 597/1175] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:07 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:08.302006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fb837-e0cf-4d6d-9813-5b7d39c6da99 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:08.350712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:08.403622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570fb837-e0cf-4d6d-9813-5b7d39c6da99 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:08.437167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:08.437824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:08.438106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:08.438382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] PATH_INFO: `/v3/domains/4c4d6b71a67642689f548ade9a367d48` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:08.439487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=4c4d6b71a67642689f548ade9a367d48)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:08.440911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a458d-6773-48c1-9347-785ae6456eb7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:08.442497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 579/1176] 10.222.0.43 () {56 vars in 1183 bytes} [Thu Sep 1 04:59:08 2022] GET /identity/v3/domains/4c4d6b71a67642689f548ade9a367d48 => generated 267 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:08.448824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:08.502901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:08.546389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124f88c-f9f5-4764-8fdd-60281af24b4d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:08.579544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:08.580085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:08.580365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:08.580642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:08.581309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:08.582734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9342105b-4b30-4024-b3b7-918993674451 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:08.603734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 598/1177] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 04:59:08 2022] POST /identity/v3/users => generated 311 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 04:59:10.531237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e6ae-c57f-43ba-87cf-8e105f9a0851 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:10.531795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e6ae-c57f-43ba-87cf-8e105f9a0851 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:10.531795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de38e6ae-c57f-43ba-87cf-8e105f9a0851 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:10.533122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 580/1178] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:10.538332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:10.538746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:10.539407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:10.557767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:10.558939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:10.623126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 599/1179] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:10 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:10.895263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e6ae-c57f-43ba-87cf-8e105f9a0851 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:10.993552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de38e6ae-c57f-43ba-87cf-8e105f9a0851 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.009762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:11.026401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.027012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.027288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.027558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.037596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:59:11.042960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:59:11.044152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:59:11.045333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 581/1180] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:59:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:59:11.050192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:11.092148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:11.147231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d507eab-360e-4559-a8d6-51de975cca12 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.180764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.181392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.181674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.181951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.182612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:11.182918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:11.184281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:11.191977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 600/1181] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:59:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:11.197839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:11.294489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c24e87f5-cce2-4c37-8bc0-cf192060d346 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.326983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.327591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.327867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.328137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] PATH_INFO: `/v3/users/c68af2e77ac441429b93291023f5ddcb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.342191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] RBAC: Authorizing `identity:get_user(user_id=c68af2e77ac441429b93291023f5ddcb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:11.345485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:11.347109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 582/1182] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:59:11 2022] GET /identity/v3/users/c68af2e77ac441429b93291023f5ddcb => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:11.353806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:11.450282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eaee0f5-21ef-442d-93f4-fe8d8eef674e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.452415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:11.482645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.483232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.483507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.483776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.552626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:11.554094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:11.650048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 601/1183] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:59:11 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:59:11.656157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:11.690791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:11.753628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cafe1e8-d00f-47db-b7aa-4ff8593548ed None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.786039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.786658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.786959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.787231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] PATH_INFO: `/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.788323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] RBAC: Authorizing `identity:get_project(project_id=0510d72fc4d64809bcc4aecd70ee5dc8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:11.790344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396bead2-3ffb-41b6-9d8d-573a1c9cdfe1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:11.791959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 583/1184] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:59:11 2022] GET /identity/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:11.798319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:11.801354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:11.892821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39318e75-3c77-4ac2-84fc-a72ea792f456 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:11.925378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:11.925967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:11.926241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:11.926506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:11.927218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=0510d72fc4d64809bcc4aecd70ee5dc8, user.id=c68af2e77ac441429b93291023f5ddcb) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:11.927521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:11.928929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a0546c-f86b-41ab-b98b-7462c5140187 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:11.934134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 602/1185] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:59:11 2022] GET /identity/v3/role_assignments?user.id=c68af2e77ac441429b93291023f5ddcb&scope.project.id=0510d72fc4d64809bcc4aecd70ee5dc8&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:13.797812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29988-fc61-4c1c-bca9-2c050919de0e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:13.798340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29988-fc61-4c1c-bca9-2c050919de0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:13.798434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a29988-fc61-4c1c-bca9-2c050919de0e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:13.799699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 584/1186] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 04:59:13.804960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:13.805398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:13.805533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:13.823851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:13.825024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:13.885379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:13.890930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 603/1187] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 04:59:14.159162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29988-fc61-4c1c-bca9-2c050919de0e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:14.255871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a29988-fc61-4c1c-bca9-2c050919de0e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:14.258811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:14.289968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:14.290530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:14.290790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:14.291058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:14.300817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:59:14.305554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:59:14.306631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 04:59:14.307644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 585/1188] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 04:59:14.312560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:14.407102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7156f203-ce31-4e28-8175-1bce8547e552 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:14.442703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:14.443238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:14.443523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:14.443793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:14.444447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:14.444747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:14.446148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:14.453929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 604/1189] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:14.459872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:14.554969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08685f-bb9f-41ee-9099-6725c24b56c5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:14.586550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:14.587152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:14.587429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:14.587702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] PATH_INFO: `/v3/users/c68af2e77ac441429b93291023f5ddcb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:14.588801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] RBAC: Authorizing `identity:get_user(user_id=c68af2e77ac441429b93291023f5ddcb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:14.590370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:14.591912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 586/1190] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:59:14 2022] GET /identity/v3/users/c68af2e77ac441429b93291023f5ddcb => generated 311 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:14.597615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:14.655543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:14.694244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba6ad13-e5a3-4bc3-9cd2-19216c9ce810 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:14.726037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:14.726814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:14.727094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:14.727369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] PATH_INFO: `/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:14.728469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] RBAC: Authorizing `identity:get_project(project_id=0510d72fc4d64809bcc4aecd70ee5dc8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:14.729918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6239b077-9788-4ec8-a436-56c6323d82ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:14.731523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 605/1191] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:59:14 2022] GET /identity/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:14.737353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:14.768198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:14.835034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a33687-e907-41dd-b4d1-5e73d7722b33 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:14.867470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818839d0-c953-411d-9151-b59806201724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:14.868113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818839d0-c953-411d-9151-b59806201724 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:14.868392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818839d0-c953-411d-9151-b59806201724 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:14.868665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818839d0-c953-411d-9151-b59806201724 None admin] PATH_INFO: `/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8/users/c68af2e77ac441429b93291023f5ddcb/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:14.870578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818839d0-c953-411d-9151-b59806201724 None admin] RBAC: Authorizing `identity:create_grant(project_id=0510d72fc4d64809bcc4aecd70ee5dc8, user_id=c68af2e77ac441429b93291023f5ddcb, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:14.872262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818839d0-c953-411d-9151-b59806201724 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:14.885023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 587/1192] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 04:59:14 2022] PUT /identity/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8/users/c68af2e77ac441429b93291023f5ddcb/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 04:59:16.811980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f9571-5434-49a5-8656-14597eeb3593 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:16.812540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f9571-5434-49a5-8656-14597eeb3593 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:16.812540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b5f9571-5434-49a5-8656-14597eeb3593 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:16.813872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 606/1193] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 04:59:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 04:59:16.819497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:16.820441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:16.820585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:16.841145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 04:59:16.842369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 04:59:16.915927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 588/1194] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 04:59:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 04:59:17.186105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f9571-5434-49a5-8656-14597eeb3593 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:17.286156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b5f9571-5434-49a5-8656-14597eeb3593 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:17.312074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:17.320645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:17.321302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:17.321586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:17.321859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:17.332126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 04:59:17.337491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 04:59:17.338579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 04:59:17.339460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 607/1195] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 04:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 04:59:17.344578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:17.368406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:17.440661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33de39a-6692-4d20-98e6-647704b3f0c7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:17.472077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:17.472664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:17.472938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:17.473225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:17.473879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:17.474179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:17.475545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:17.483688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 589/1196] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 04:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:17.489523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:17.588933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf9a169-8b6d-457f-9707-4b70a52dd7ed None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:17.621444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:17.622490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:17.622857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:17.623245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] PATH_INFO: `/v3/users/c68af2e77ac441429b93291023f5ddcb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:17.624493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] RBAC: Authorizing `identity:get_user(user_id=c68af2e77ac441429b93291023f5ddcb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:17.625939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:17.627484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 608/1197] 10.222.0.43 () {56 vars in 1177 bytes} [Thu Sep 1 04:59:17 2022] GET /identity/v3/users/c68af2e77ac441429b93291023f5ddcb => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:17.633983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:17.721161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:17.737039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcfea3a8-a024-4fc5-9a41-c772de356ea1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:17.770238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:17.770825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:17.771100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:17.771369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:17.834332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:17.835790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:17.913586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:17.929664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 590/1198] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 04:59:17 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 04:59:17.935710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:17.990965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:18.034426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e769d4-1163-4468-a378-8ddc7d124ddb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:18.066256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:18.066871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:18.067152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:18.067425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] PATH_INFO: `/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:18.068522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0510d72fc4d64809bcc4aecd70ee5dc8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:18.070561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb288f0-71e7-4141-86fe-a984070876a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:18.072248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 609/1199] 10.222.0.43 () {56 vars in 1186 bytes} [Thu Sep 1 04:59:17 2022] GET /identity/v3/projects/0510d72fc4d64809bcc4aecd70ee5dc8 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:18.078324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 04:59:18.173556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97505d93-ab9d-4f69-aba6-5459b79e454c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 04:59:18.205511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 04:59:18.206101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 04:59:18.206378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 04:59:18.206650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 04:59:18.207358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=0510d72fc4d64809bcc4aecd70ee5dc8, user.id=c68af2e77ac441429b93291023f5ddcb) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 04:59:18.207662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 04:59:18.209063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12dadedf-50ac-42ee-8ad9-6d33d7e1a80f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 04:59:18.215230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 591/1200] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 04:59:18 2022] GET /identity/v3/role_assignments?user.id=c68af2e77ac441429b93291023f5ddcb&scope.project.id=0510d72fc4d64809bcc4aecd70ee5dc8&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 04:59:28.062245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=38 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 04:59:28.212848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=76 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:13.363565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26ffc-d3cc-4592-ad78-9a81791e5808 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:13.364182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26ffc-d3cc-4592-ad78-9a81791e5808 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:13.364182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a26ffc-d3cc-4592-ad78-9a81791e5808 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:13.365844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 610/1201] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:13.371616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:13.372144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:13.372240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:13.393163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:13.394479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:13.484659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 592/1202] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:13.765801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26ffc-d3cc-4592-ad78-9a81791e5808 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:13.888149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a26ffc-d3cc-4592-ad78-9a81791e5808 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:13.937743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:13.937743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:13.937743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:13.937743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:13.950716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:13.952184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:13.968542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:13.970056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:13.971315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:13.971315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:13.971315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:13.971315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 611/1203] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:13.976184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:14.091067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d2d3e4-847c-40c9-b443-4e5fda66461f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:14.125098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:14.133493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:14.134182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:14.134499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:14.134773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:14.135432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:14.135854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:14.137330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-835374de-9bd4-40d0-85e3-5505c3575b1e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:14.157220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 593/1204] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:14.157433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:14.222316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:14.283958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdda95-ef3a-4120-b486-b2fc98586f23 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:14.331284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:14.331895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:14.332200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:14.332527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:14.333154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:14.334764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31314dd-3eb0-4663-9d06-8c7d784aecf4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:14.358646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 612/1205] 10.222.0.43 () {60 vars in 1132 bytes} [Thu Sep 1 05:00:14 2022] POST /identity/v3/users => generated 251 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:00:16.586541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042943-28fb-4494-82d4-6de8edd39fed None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:16.587133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042943-28fb-4494-82d4-6de8edd39fed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:16.587133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49042943-28fb-4494-82d4-6de8edd39fed None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:16.588422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 594/1206] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:16.594407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:16.594969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:16.594969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:16.618642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:16.620120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:16.704978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 613/1207] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:16.983604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49042943-28fb-4494-82d4-6de8edd39fed None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:17.098242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49042943-28fb-4494-82d4-6de8edd39fed None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:17.139376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:17.140230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:17.140550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:17.140875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:17.154733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:17.160276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:17.162129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:17.168028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 595/1208] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 05:00:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:17.170794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:17.219296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:17.296834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2355e9dc-1f39-4157-a773-4f0103b64459 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:17.343997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:17.344627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:17.344874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:17.345146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:17.345863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:17.346167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:17.348008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:17.363768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 614/1209] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 05:00:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:17.366856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:17.429796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:17.498416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b868eadd-88fd-4a9f-ab19-b30882af7d90 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:17.540109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:17.540864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:17.541173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:17.541459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:17.553600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:17.555048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:17.574242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:17.575505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:17.576704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:17.576704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:17.576704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:17.582648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 596/1210] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:17.585819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:17.698521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:17.702497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b393a46f-d6d5-49de-913b-602384de7eb7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:17.751522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:17.752189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:17.752543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:17.752892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:17.753798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:17.754127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:17.756574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:17.772886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 615/1211] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:17.780808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:17.897257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8f82d2-a4ce-42ac-bdbb-9cd293bdb351 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:17.899118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:17.936612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:17.937376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:17.937657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:17.937924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:17.946178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:17.947942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:17.960266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:17.965408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:17.966633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 597/1212] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:17 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:00:17.968670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:18.082139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978e50c-8baa-45a2-9fcf-3b861d9f50d0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:18.121499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:18.122110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:18.122406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:18.122650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:18.123382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:18.123677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:18.125282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:18.149261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 616/1213] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:17 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:18.155081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:18.287086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f0c794-4ba5-43eb-bad4-f6bd7831521c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:18.331458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:18.332227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:18.332358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:18.332667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:18.368435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:18.417045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:18.418619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:18.532606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 598/1214] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 05:00:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:00:18.539111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:18.559338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:18.654761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3b49f-a884-49d7-8e04-b4e5e7fabce5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:18.700152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:18.700868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:18.701254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:18.701495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:18.713204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:18.714810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:18.732062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:18.733260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:18.739487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:18.739487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:18.739487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:18.739487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 617/1215] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:18.739790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:18.808888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:18.849658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b5097f-dd10-42d6-b205-4cc16d12103c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:18.886583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:18.887312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:18.887595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:18.887861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:18.888504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:18.888805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:18.890310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:18.903494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 599/1216] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:18.909655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:19.014055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:19.063728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13243715-f4a3-4f77-91e2-5e4f4233c96e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:19.102071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:19.102701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:19.102974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:19.103249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:19.109918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:19.111522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:19.126268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:19.127454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:19.128578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:19.130065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 618/1217] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:19.135789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:19.255338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6e0ea3-affc-41d3-81cd-0b1b470d3cef None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:19.280138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:19.300627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:19.302321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:19.302993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:19.303634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:19.304947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:19.305535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:19.307625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5646c9ef-58b4-43d5-a49b-0cf641443ea5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:19.326568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 600/1218] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:19.332323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:19.459688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a197ed-ab1b-4242-a0a8-5d06e84b8565 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:19.490903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:19.499839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:19.500691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:19.501135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:19.501667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:19.502941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fdc935f85996421c8758edab8f2b7202) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:19.503489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:19.506798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff138ad1-0c8e-4f12-ad5f-f5af2dde4c53 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:19.514446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 619/1219] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 05:00:19 2022] GET /identity/v3/role_assignments?user.id=fdc935f85996421c8758edab8f2b7202&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:21.478987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d152aa-e6c1-4eef-8bdd-f2cc2d6ea494 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:21.479537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d152aa-e6c1-4eef-8bdd-f2cc2d6ea494 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:21.479537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d152aa-e6c1-4eef-8bdd-f2cc2d6ea494 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:21.480930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 601/1220] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:21.486139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:21.486533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:21.486707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:21.506724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:21.507906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:21.579282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 620/1221] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 01 05:00:21.866240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d152aa-e6c1-4eef-8bdd-f2cc2d6ea494 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:21.975220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d152aa-e6c1-4eef-8bdd-f2cc2d6ea494 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.009789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.010470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.010749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.011016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.022185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:22.027258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:22.028358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:22.029255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 602/1222] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 05:00:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:22.034623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:22.138274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d0d66d-f465-498c-9d99-e927291c74af None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.163104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:22.175095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.175706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.175986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.176788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.177491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:22.177796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:22.179151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:22.186903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 621/1223] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:22.194281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:22.246666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:22.309093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620f8f43-623b-4d2b-8d35-1068971b46de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.346475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.347323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.347747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.348784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.361369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:22.362994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:22.379576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:22.380762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:22.381859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:22.381859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:22.381859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:22.381859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 603/1224] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:22.387695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:22.494003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f62d67a-2f20-46aa-aa97-1d222b3cdc52 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.528419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.529024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.529341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.529616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.530262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:22.530569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:22.531925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:22.545629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 622/1225] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:22.551125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:22.652359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:22.660260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e12d76-f37c-4874-8f28-6589c90095b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.695545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.696276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.696570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.696844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.706106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:22.707794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:22.722282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:22.724009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:22.725019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 604/1226] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:00:22.730295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:22.780085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:22.839858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399c525b-1379-445f-a3cc-8a9c0bd33b56 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:22.877708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:22.878325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:22.878683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:22.879183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:22.880647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:22.880973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:22.882653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:22.901743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 623/1227] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:00:22.907773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:23.021257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d3f311-b017-4832-9777-49c2587f6e23 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:23.059724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:23.060305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:23.060602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:23.060857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:23.074099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:23.075933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:23.092247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:23.093436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:23.094441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:23.094441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:23.094441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:23.094441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 605/1228] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:23.100179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:23.209752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33548d08-d39d-4649-8d60-3a364a4ac63a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:23.212410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:23.250521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:23.251156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:23.251453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:23.251763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:23.252403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:23.252723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:23.254192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:23.266655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 624/1229] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:23.273586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:23.284388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:23.388000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc00c13-0ef8-4a47-8e52-eff231627b73 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:23.423998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:23.424747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:23.425024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:23.425334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:23.433522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:23.435077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:23.448503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:23.449628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:23.455531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 606/1230] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:23.457200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:23.563735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a87f-57cb-4714-bcfe-2e01c75f6047 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:23.598993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:23.599669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:23.600021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:23.600320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:23.601109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:23.601517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:23.603179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86a6521-af4d-4a1f-9b32-1a43dfde4458 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:23.616397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 625/1231] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:23.622732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:23.693787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:23.730701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17f3649-5f76-400b-a7bd-f7324907ae88 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:23.771621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:23.772429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:23.772681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:23.772963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fdc935f85996421c8758edab8f2b7202/roles/e68fedb6ba4d44dda5eae563407f520d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:23.789216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=fdc935f85996421c8758edab8f2b7202, role_id=e68fedb6ba4d44dda5eae563407f520d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:23.790839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfb256-ce55-4d8d-ad13-127361f9f41c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:23.804166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 607/1232] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 05:00:23 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fdc935f85996421c8758edab8f2b7202/roles/e68fedb6ba4d44dda5eae563407f520d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:00:25.769818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456bcc-3c14-4e79-8ed5-b024389476a5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:25.771023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456bcc-3c14-4e79-8ed5-b024389476a5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:25.771212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf456bcc-3c14-4e79-8ed5-b024389476a5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:25.773219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 626/1233] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:25.778638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:25.779119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:25.779210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:25.798081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:25.799728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:25.872698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 608/1234] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:26.149840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456bcc-3c14-4e79-8ed5-b024389476a5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:26.179962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:26.266445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf456bcc-3c14-4e79-8ed5-b024389476a5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:26.307452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:26.308647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:26.308994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:26.309298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:26.323593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:26.329438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:26.330577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:26.331961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 627/1235] 10.222.0.43 () {56 vars in 1102 bytes} [Thu Sep 1 05:00:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:26.337822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:26.392914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:26.456955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e959792-487b-4b7e-b377-fd34a2958d72 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:26.494229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:26.494747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:26.495028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:26.495304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:26.495960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:26.496266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:26.497657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:26.506315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 609/1236] 10.222.0.43 () {56 vars in 1103 bytes} [Thu Sep 1 05:00:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:26.512156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:26.606363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:26.623832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6593c7-d3e7-4a4a-a305-aea49d3a8be8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:26.659085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:26.659770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:26.660144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:26.661034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:26.671670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:26.673159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:26.687959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:26.690077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:26.690981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:26.690981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:26.690981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:26.690981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 628/1237] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:26.695307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:26.810459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed581a0-4a05-4e47-9d0b-43436368d0de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:26.821154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:26.848910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:26.849740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:26.850139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:26.850412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:26.851088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:26.851388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:26.852742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:26.869273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 610/1238] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:26.876407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:26.985648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06576520-de96-4d51-a394-0cf9b1a4ca81 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:27.020511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:27.021141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:27.021453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:27.021725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:27.024518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:27.029860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:27.031420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:27.043023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:27.044014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:27.045479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 629/1239] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:27.050321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:27.157094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3250ad-c194-4476-9d4a-ae4c529fe782 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:27.196074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:27.196942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:27.197386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:27.197771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:27.198692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:27.199082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:27.200906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:27.224150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 611/1240] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:27 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:27.230690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:27.344715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5a6756-cad6-4c56-a54a-bc42635b9091 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:27.386036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:27.386678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:27.386952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:27.387224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:27.452193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:27.459539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:27.461092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:27.572056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 630/1241] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 05:00:27 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 01 05:00:27.578563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:27.608845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:27.689460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d5950e-05c1-4fb9-a1ae-1d68346fe5cd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:27.726858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:27.727445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:27.727724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:27.727996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:27.739777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:27.741455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:27.757711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:27.758881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:27.759815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:27.759815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:27.759815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:27.759815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 612/1242] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:27.765375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:27.870489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:27.879461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743bd33f-f80c-4992-822e-ba6eb770c93e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:27.920478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:27.921146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:27.921419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:27.921694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:27.922339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:27.922640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:27.924173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:27.937556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 631/1243] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:27.943437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:28.028531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:28.053657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693de7ec-dab9-4878-a148-9e71f8047f95 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:28.089331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:28.090041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:28.090328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:28.090599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:28.097463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:28.099016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:28.111106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:28.112092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:28.113023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 613/1244] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:28.119221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:28.228790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354ed135-e0de-4eef-b85e-fcc4985324a4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:28.262601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:28.263301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:28.263654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:28.263923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:28.264720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:28.265028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:28.266641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf07024d-bae1-4279-a933-bada04334882 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:28.280274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 632/1245] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:28.287144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:28.405975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1cd31d-9a2e-4ffc-9a18-de25c0fbbcf0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:28.447176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:28.447916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:28.448301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:28.448566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:28.449484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] RBAC: Adding query filter params (role.id=e68fedb6ba4d44dda5eae563407f520d, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fdc935f85996421c8758edab8f2b7202) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:28.449879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:28.451817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe31fdd3-bf9d-4e57-b504-0acbbd655827 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:28.458300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 614/1246] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 05:00:28 2022] GET /identity/v3/role_assignments?user.id=fdc935f85996421c8758edab8f2b7202&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=e68fedb6ba4d44dda5eae563407f520d => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:00:30.761317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8578b-b279-4f56-94a7-40f3b88403c6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:30.761855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8578b-b279-4f56-94a7-40f3b88403c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:30.761855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c8578b-b279-4f56-94a7-40f3b88403c6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:30.763677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 633/1247] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:30.770819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:30.771405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:30.771532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:30.779630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:30.794348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:30.795949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:30.881215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 615/1248] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:31.194872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8578b-b279-4f56-94a7-40f3b88403c6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:31.218671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:31.313537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c8578b-b279-4f56-94a7-40f3b88403c6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:31.362492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:31.363928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:31.364414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:31.364973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:31.377880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:31.385164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:31.386440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:31.387351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 634/1249] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 05:00:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:31.392726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:31.500994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc3f3f-7fb7-4fca-aa28-a2a7d825e810 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:31.535736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:31.541886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:31.542504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:31.542780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:31.543183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:31.544037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:31.544340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:31.546043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:31.555473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 616/1250] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 05:00:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:31.562041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:31.649824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:31.678491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534e80e0-c020-45be-996b-212e81bc02ba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:31.717552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:31.718207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:31.718550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:31.718824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:31.729768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:31.731530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:31.748283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:31.749356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:31.750324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:31.750324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:31.750324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:31.750324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 635/1251] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:31.756625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:31.875413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542e71b0-2a87-4c50-a9cc-6ada85806657 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:31.914395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:31.915006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:31.915253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:31.915528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:31.916185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:31.916495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:31.917880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:31.931919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 617/1252] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:31.937896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:32.052920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb627479-bf78-41f1-9b7c-70b808f37c62 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:32.079236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.088516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:32.089162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:32.089554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:32.089817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:32.099446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:32.100880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:32.111925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:32.112874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:32.114422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 636/1253] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:31 2022] GET /identity/v3/users/placement => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:32.120083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:32.183630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.238026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54ddeb-cfb7-4b4d-a850-36367f44bbaf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:32.278393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:32.279010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:32.279292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:32.279572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:32.280302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:32.280640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:32.282089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:32.299689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 618/1254] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:32.306307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:32.429067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ad1199-a567-4a62-9404-fa1656b192bd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:32.469455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:32.470070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:32.470350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:32.470623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:32.532378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.546459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:32.547914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:32.652501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 637/1255] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 05:00:32 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:00:32.658460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:32.773674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98c143a-496b-4457-9071-f5cd4f871ec2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:32.787495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.809508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:32.810131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:32.810406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:32.810675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:32.820436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:32.821904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:32.837568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:32.838856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:32.839795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:32.839795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:32.839795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:32.839795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 619/1256] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:32.844558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:32.936992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:32.949536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db2c996-d02a-4a7a-98f4-6d044d044550 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:32.985650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:32.986258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:32.986536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:32.986808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:32.987447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:32.987748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:32.989854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:33.001046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 638/1257] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:00:33.007514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:33.119997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337b9f04-f1da-4b3a-88f6-64abf6adcdf6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:33.159299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:33.160665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:33.160940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:33.161251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:33.168008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:33.169643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:33.182967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:33.184098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:33.185214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:33.186487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 620/1258] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:33.192581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:33.298117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa368241-d73e-4a85-b1b9-387c7fa05067 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:33.337655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:33.338594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:33.339022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:33.339430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:33.340551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:33.340945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:33.342984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4283e9-9502-47f4-b6d4-c15ce60683c8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:33.366489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 639/1259] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:33.367867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:33.396060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:33.477917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289c12f1-81a3-47ce-a848-adcf3063eeab None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:33.515384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:33.516115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:33.516398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:33.516696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:33.517563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fdc935f85996421c8758edab8f2b7202) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:33.517876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:33.519504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a90da3-3f5a-4fec-bf25-6bb149981ff0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:33.525836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 621/1260] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 05:00:33 2022] GET /identity/v3/role_assignments?user.id=fdc935f85996421c8758edab8f2b7202&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 259 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:35.433867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75d91-0658-46d3-a860-f2af43f2c16a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:35.434413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75d91-0658-46d3-a860-f2af43f2c16a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:35.434413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa75d91-0658-46d3-a860-f2af43f2c16a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:35.435721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 640/1261] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:35.440737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:35.441105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:35.441351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:35.459120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:35.460289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:35.525469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 622/1262] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:35.793877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa75d91-0658-46d3-a860-f2af43f2c16a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:35.805145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:35.897586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa75d91-0658-46d3-a860-f2af43f2c16a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:35.933134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:35.933790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:35.934069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:35.934341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:35.944755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:35.951660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:35.952773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:35.953846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 641/1263] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 05:00:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:35.959314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:35.977495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.054403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8476dff1-6843-43f8-a1e4-d253a2928ec9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.087121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.087709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.087991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.088261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.088908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:36.089227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.090564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.098179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 623/1264] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 05:00:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:36.104025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:36.169033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.201643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac615cf-0f88-4078-83fd-931592e1ccc9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.233684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.234297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.234577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.234847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.245765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.247189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:36.260826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:36.261940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:36.263060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:36.263060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:36.263060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:36.263060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 642/1265] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:36.267767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:36.358124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.379371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca431d41-cc1e-46ed-961d-f85bd16e3e6c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.412169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.412762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.413041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.413341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.413977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:36.414278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.415623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.426831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 624/1266] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:36.432649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:36.530294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d866d9e-83da-45d1-8527-b9fea014e106 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.549417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.563038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.563644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.563919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.564187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.571364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.572785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:36.584149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:36.585283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:36.586680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 643/1267] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:36.591230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:36.687216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb145e-f505-4cfe-b23f-ac3dc95bdf8e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.719485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.720078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.720358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.720632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.721380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:36.721687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.723161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.731360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:36.740794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 625/1268] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:36.746809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:36.845320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e06a5bb-9490-4249-8315-791472a9f839 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:36.877041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:36.877690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:36.877979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:36.878273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:36.889031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:36.890501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:36.904774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:36.910715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:36.911887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:36.911887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:36.911887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:36.911887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 644/1269] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:36.912176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:37.007835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a1db4-7598-48b4-b2bb-91da1bbb25d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:37.040807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:37.041423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:37.041697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:37.041962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:37.042588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:37.042883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:37.044226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:37.055373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 626/1270] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:37.061001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:37.091612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:37.158921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71ada4a2-7c66-4cd2-9030-cc7acfbfdca4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:37.191283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:37.191899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:37.192175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:37.192444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:37.198856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:37.200258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:37.212276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:37.213362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:37.214672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 645/1271] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:37.219152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:37.275661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:37.318128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a992316-a8ec-4f0b-94bb-fa0baee54f27 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:37.354467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491db57c-2023-4b0f-b784-be890043817b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:37.355063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db57c-2023-4b0f-b784-be890043817b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:37.355375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db57c-2023-4b0f-b784-be890043817b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:37.355648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491db57c-2023-4b0f-b784-be890043817b None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:37.356336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db57c-2023-4b0f-b784-be890043817b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:37.356640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db57c-2023-4b0f-b784-be890043817b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:37.358089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491db57c-2023-4b0f-b784-be890043817b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:37.370281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 627/1272] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:37.376228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:37.463932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:37.472643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cc28b0-7ce5-4933-a673-699352a2677f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:37.505680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:37.506305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:37.506580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:37.506850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] PATH_INFO: `/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fdc935f85996421c8758edab8f2b7202/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:37.508675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] RBAC: Authorizing `identity:create_grant(project_id=f2f0d34c3c6049fb9a33c816ad607755, user_id=fdc935f85996421c8758edab8f2b7202, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:37.510125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba96cb0a-4bf5-42e7-816c-ab901cf81383 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:37.523199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 646/1273] 10.222.0.43 () {58 vars in 1439 bytes} [Thu Sep 1 05:00:37 2022] PUT /identity/v3/projects/f2f0d34c3c6049fb9a33c816ad607755/users/fdc935f85996421c8758edab8f2b7202/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:00:39.415701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe99b87-5280-4d2d-b42d-5e7ccfcc4c2e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:39.416280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe99b87-5280-4d2d-b42d-5e7ccfcc4c2e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:39.416280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe99b87-5280-4d2d-b42d-5e7ccfcc4c2e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:39.417616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 628/1274] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:39.422791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:39.423208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:39.423338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:39.441213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:39.442381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:39.505903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 647/1275] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:39.771848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe99b87-5280-4d2d-b42d-5e7ccfcc4c2e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:39.871884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe99b87-5280-4d2d-b42d-5e7ccfcc4c2e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:39.890996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:39.907168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:39.907783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:39.908062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:39.908337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:39.918489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 01 05:00:39.923239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:39.924417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:39.925566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 629/1276] 10.222.0.43 () {56 vars in 1096 bytes} [Thu Sep 1 05:00:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:39.930920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.009024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:40.027562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25af64ad-a4f9-46df-8a91-f513f0441667 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.060433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.061038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.061351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.061625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.062288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:40.062617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.063968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:40.072193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 648/1277] 10.222.0.43 () {56 vars in 1099 bytes} [Thu Sep 1 05:00:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:40.077938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.175428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b8daa5-1324-4d7e-b2ec-ae49b016fab5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.208659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.209296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.209576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.209847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.219320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.220740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:40.234845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:40.235968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:40.237117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:40.237117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:40.237117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:40.237117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 630/1278] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:40.242529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.348293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0569892-3bf4-4b1b-8a0a-2b041c4dfdf9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.386969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.387573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.387854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.388129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.388771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:40.389075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.390467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:40.402830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 649/1279] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:40.408511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.440232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:40.506907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1f6d1f-18fe-43ec-b2c7-a879c0310b3b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.538708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.539314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.539587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.539852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.546839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.548248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 01 05:00:40.560103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:40.565424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:40.566584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 631/1280] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:40.567402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.571419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:40.668058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529a5a64-9bab-414f-b8c4-7a3ed0fad83e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.701043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.701676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.701958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.702230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.702954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:40.703258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.704677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:40.722024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 650/1281] 10.222.0.43 () {56 vars in 1143 bytes} [Thu Sep 1 05:00:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:00:40.728351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:40.814900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:40.825019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d044b7c-4ebd-48b6-b908-19bc6220a0f4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:40.856793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:40.857400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:40.857675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:40.857941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:40.922191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:40.923627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.013339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:41.024305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 632/1282] 10.222.0.43 () {58 vars in 1282 bytes} [Thu Sep 1 05:00:40 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 01 05:00:41.030110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:41.088894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:41.126387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f4fbc8-10e4-4fc3-815d-29f0e1387fbe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:41.158890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:41.159505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:41.159781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:41.160051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:41.169788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:41.171207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 01 05:00:41.185697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:41.186818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 01 05:00:41.187936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 01 05:00:41.187936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 01 05:00:41.187936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:41.187936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 651/1283] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:00:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:41.193285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:41.291453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff57ae78-4cef-4969-b37b-3466defe7673 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:41.329081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:41.329711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:41.329992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:41.330266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:41.330906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:41.331207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:41.332566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.343428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 633/1284] 10.222.0.43 () {56 vars in 1109 bytes} [Thu Sep 1 05:00:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:41.349729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:41.445735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a89cc44-cc3a-4a0a-8c1a-53dfc2857a94 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:41.458543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:41.478656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:41.479275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:41.479551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:41.479821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:41.486218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:41.487685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 01 05:00:41.499539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:41.500614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Sep 01 05:00:41.501721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 652/1285] 10.222.0.43 () {56 vars in 1111 bytes} [Thu Sep 1 05:00:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:41.506486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:41.556765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:41.605513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e053a609-da63-41cd-b4c4-5b80aef3a171 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:41.637620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:41.638211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:41.638487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:41.638756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:41.639436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:41.639737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:41.641157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90069e1d-2d08-472c-a89a-fe81e45a4c59 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.653589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 634/1286] 10.222.0.43 () {56 vars in 1148 bytes} [Thu Sep 1 05:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:41.659568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:41.754948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fec946-ba20-45ac-8fe9-bab7b2f86271 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:41.787312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:41.787893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:41.788178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:41.788450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:41.789162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] RBAC: Adding query filter params (role.id=735711bc5949482f97472a303cdeab41, scope.project.id=f2f0d34c3c6049fb9a33c816ad607755, user.id=fdc935f85996421c8758edab8f2b7202) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:41.789500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:41.790912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8235c669-14eb-4655-b0e7-8923efc3f136 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:41.796393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 653/1287] 10.222.0.43 () {56 vars in 1374 bytes} [Thu Sep 1 05:00:41 2022] GET /identity/v3/role_assignments?user.id=fdc935f85996421c8758edab8f2b7202&scope.project.id=f2f0d34c3c6049fb9a33c816ad607755&role.id=735711bc5949482f97472a303cdeab41 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:43.732161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c615-71c7-42ce-b179-7da67d592a66 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:43.732694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c615-71c7-42ce-b179-7da67d592a66 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:43.732694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e5c615-71c7-42ce-b179-7da67d592a66 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:43.734059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 635/1288] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:43.739847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:43.740218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:43.740393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:43.758429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:43.759651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:43.788006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:43.825274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 654/1289] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:44.106356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5c615-71c7-42ce-b179-7da67d592a66 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:44.207229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e5c615-71c7-42ce-b179-7da67d592a66 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:44.217954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:44.240499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:44.241115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:44.241419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:44.241693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:44.242265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:44.243883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:44.252300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:44.253583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:44.255194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 636/1290] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 05:00:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 01 05:00:44.260192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:44.366512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664ab722-a38f-41e7-9838-3bd41ce5cd44 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:44.402161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:44.402761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:44.403038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:44.403308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:44.403924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:44.404221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:44.405627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6885ae79-d7ec-4267-b8b0-8ae67b625277 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:44.410272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 655/1291] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 05:00:44 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:44.416076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:44.511499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ce05bc-77c4-4e19-99fa-0ab60c6785b6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:44.543757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:44.544336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:44.544614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:44.544884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:44.545530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:44.545834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:44.547173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfed637-09d2-4738-a808-93487af81323 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:44.551368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 637/1292] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 05:00:44 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:46.435642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03827-435c-4c27-b84b-c73cf3c3f372 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:46.436187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03827-435c-4c27-b84b-c73cf3c3f372 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:46.436187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d03827-435c-4c27-b84b-c73cf3c3f372 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:46.437554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 656/1293] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:46.443235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7e0e-db68-4148-9d9b-48992a328c7d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:46.443667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7e0e-db68-4148-9d9b-48992a328c7d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:46.443769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7d7e0e-db68-4148-9d9b-48992a328c7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:46.461778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ab7d7e0e-db68-4148-9d9b-48992a328c7d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:46.462961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab7d7e0e-db68-4148-9d9b-48992a328c7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:46.492298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:46.528503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 638/1294] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:46.796652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d03827-435c-4c27-b84b-c73cf3c3f372 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:46.827173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:46.896383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d03827-435c-4c27-b84b-c73cf3c3f372 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:46.929150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:46.929769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:46.930046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:46.930318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:46.930963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:46.932324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e40213d-331b-4f82-8992-e5e5378f3d67 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:46.947420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 657/1295] 10.222.0.43 () {60 vars in 1141 bytes} [Thu Sep 1 05:00:46 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:00:48.832487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a99045-d12e-4d24-ba48-e2134d1e1572 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:48.833021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a99045-d12e-4d24-ba48-e2134d1e1572 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:48.833141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a99045-d12e-4d24-ba48-e2134d1e1572 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:48.834504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 639/1296] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:48.839596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:48.840031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:48.840128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:48.858274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:48.859442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:48.929396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 658/1297] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:49.194183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a99045-d12e-4d24-ba48-e2134d1e1572 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:49.292320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a99045-d12e-4d24-ba48-e2134d1e1572 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:49.325520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:49.326141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:49.326420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:49.326695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:49.327273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:49.328664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:49.337667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:49.338658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:49.339530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 640/1298] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 05:00:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:49.344745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:49.363001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:49.440798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7923fc-a2d9-4060-8ad2-f73353d3944a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:49.473708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:49.474234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:49.474511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:49.474780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:49.475394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:49.475693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:49.477046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:49.481948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 659/1299] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 05:00:49 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:49.487757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:49.518752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:49.585479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e8fe-d30d-4f59-ac8c-19d41de1c1ad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:49.617075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:49.617952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:49.618236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:49.618510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:49.619202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] RBAC: Adding query filter params (interface=public, service_id=efe4f4336eb546e1b90fff19ef689812, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:49.619507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:49.620860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69501b47-181e-4b61-aa3a-fb70864aadae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:49.625674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 641/1300] 10.222.0.43 () {56 vars in 1251 bytes} [Thu Sep 1 05:00:49 2022] GET /identity/v3/endpoints?service_id=efe4f4336eb546e1b90fff19ef689812&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:00:49.631717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:49.710108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:49.727488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca0d222-45ae-4d7b-b95b-f90bcc7e23f8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:49.760007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:49.760592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:49.760864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:49.761132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:49.761747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:49.763092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b872c8-f0c7-4c1d-86fc-216bcdd8dd36 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:49.769692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 660/1301] 10.222.0.43 () {56 vars in 1087 bytes} [Thu Sep 1 05:00:49 2022] GET /identity/v3/services => generated 2191 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:00:51.669320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43b53-7731-4c41-9579-0fdcae2ecc3a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:51.669868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43b53-7731-4c41-9579-0fdcae2ecc3a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:51.669868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c43b53-7731-4c41-9579-0fdcae2ecc3a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:51.671184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 642/1302] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:00:51.676247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:51.676678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:51.676796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:51.694905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:00:51.696062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:00:51.759066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 661/1303] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:00:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 01 05:00:52.024981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43b53-7731-4c41-9579-0fdcae2ecc3a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:52.117874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:52.124915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c43b53-7731-4c41-9579-0fdcae2ecc3a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:52.156930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:52.157567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:52.157845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:52.158122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] PATH_INFO: `/v3/services/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:52.158693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:52.160034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 01 05:00:52.169057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 01 05:00:52.170301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Sep 01 05:00:52.171335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 643/1304] 10.222.0.43 () {56 vars in 1117 bytes} [Thu Sep 1 05:00:52 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 01 05:00:52.176047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:52.249490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:00:52.272505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfda759e-366d-477f-9886-c5b0ae7d3ba8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:52.306186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:52.306793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:52.307069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:52.307342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:52.307974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] RBAC: Adding query filter params (name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:00:52.308349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:52.309816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca068b96-34ac-4ced-a522-35301564d2ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:52.316112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 662/1305] 10.222.0.43 () {56 vars in 1116 bytes} [Thu Sep 1 05:00:52 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:00:52.322925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:00:52.423618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b76c54d-69ab-43ac-8ee2-7e2fe5b326fc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:00:52.455880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:00:52.456467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:00:52.456743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:00:52.457013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:00:52.458448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:00:52.459723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886152e7-8d5b-4202-8d61-a5ed2e99aa7a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:00:52.478583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 644/1306] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:00:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:01:02.312415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=30 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:02.478104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:56.115038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf586-ccf6-4394-9b88-003631d89668 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:56.116410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf586-ccf6-4394-9b88-003631d89668 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:56.117142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbaf586-ccf6-4394-9b88-003631d89668 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:56.130486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f11e4-c6a0-41e2-a9fe-e31087eb2ef0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:56.130946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f11e4-c6a0-41e2-a9fe-e31087eb2ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:56.131290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48f11e4-c6a0-41e2-a9fe-e31087eb2ef0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:56.135653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 663/1307] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:01:56 2022] GET /identity => generated 270 bytes in 22 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:01:56.257064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b48f11e4-c6a0-41e2-a9fe-e31087eb2ef0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:01:56.259709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b48f11e4-c6a0-41e2-a9fe-e31087eb2ef0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:01:56.418507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 645/1308] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:01:56.711618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:56.711980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:56.712461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:56.713926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 664/1309] 10.222.0.43 () {54 vars in 965 bytes} [Thu Sep 1 05:01:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:01:56.720470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566877-f8c5-4392-94b7-6f1862969e4b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:56.720787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566877-f8c5-4392-94b7-6f1862969e4b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:56.721025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81566877-f8c5-4392-94b7-6f1862969e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:56.811692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-81566877-f8c5-4392-94b7-6f1862969e4b None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:01:56.812938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-81566877-f8c5-4392-94b7-6f1862969e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:01:56.837578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:56.901958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 646/1310] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Sep 1 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:01:56.910935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:01:56.912828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:01:57.030681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295143fa-2676-4fb8-bfdb-979f6c69038a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:01:57.113979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:01:57.115380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:57.115380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:57.115905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:57.117431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:01:57.180045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:01:57.238306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:01:57.240243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbb2961-2fbc-4246-a988-c31418670b75 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:01:57.260916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 665/1311] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:01:59.515479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:59.516063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:59.516063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:59.521214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 647/1312] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:01:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:01:59.522900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cecee-bb20-4f65-88c5-89442a10b04e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:01:59.523336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cecee-bb20-4f65-88c5-89442a10b04e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:01:59.523523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819cecee-bb20-4f65-88c5-89442a10b04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:01:59.597485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-819cecee-bb20-4f65-88c5-89442a10b04e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:01:59.598759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-819cecee-bb20-4f65-88c5-89442a10b04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:01:59.705834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 666/1313] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:01:59.989008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:01:59.990829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:00.091501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c56b681-a4c9-4ae3-b559-8aab2956c875 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:00.164211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:00.167228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:00.167867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:00.168304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:00.168574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:00.170187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:00.274733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:00.276070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c2f530-3057-41a3-94b0-82960351486a service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:00.293765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 648/1314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:02.498780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:02.499347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:02.499347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:02.500647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 667/1315] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:02.506427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879b91-7f44-4c07-a5e1-1b88bc35e394 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:02.506839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879b91-7f44-4c07-a5e1-1b88bc35e394 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:02.506955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07879b91-7f44-4c07-a5e1-1b88bc35e394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:02.570941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-07879b91-7f44-4c07-a5e1-1b88bc35e394 None None] MFA Rules not processed for user `39a86a262916418689a8a39b9c57efca`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:02.572127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07879b91-7f44-4c07-a5e1-1b88bc35e394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:02.624983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:02.668710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 649/1316] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:02.953628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:02.955143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:02.965423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:03.058221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328b10e0-08e5-4f1a-9c0c-74e16c55c14c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:03.129406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:03.130004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:03.130282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:03.130553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:03.132160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:03.191935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:03.239172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:03.240805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60403cb-19b5-4a7c-87ce-039d63db9036 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:03.258226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 668/1317] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:05.671840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:05.672276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:05.672369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:05.673811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 650/1318] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:05.679427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da865-acac-43d8-ac5b-7ce7efb4902d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:05.679858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da865-acac-43d8-ac5b-7ce7efb4902d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:05.679979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544da865-acac-43d8-ac5b-7ce7efb4902d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:05.744963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-544da865-acac-43d8-ac5b-7ce7efb4902d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:05.746172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-544da865-acac-43d8-ac5b-7ce7efb4902d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:05.839170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 669/1319] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:06.126761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:06.128482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:06.229113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f6c75c-c62c-4342-805e-8185bf47fddf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:06.299086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:06.300211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:06.300470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:06.300740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:06.302321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:06.310376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:06.409747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:06.411175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e1cb1-b318-43c7-ab7a-af50f8d4eecb service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:06.428989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 651/1320] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:08.978164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81917-9abf-432e-b1db-8d1bc6d56e5b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:08.978680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81917-9abf-432e-b1db-8d1bc6d56e5b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:08.978801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f81917-9abf-432e-b1db-8d1bc6d56e5b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:08.980026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 670/1321] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:08.985089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8c68-7b27-4ca9-bd3f-0973c08e7fcb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:08.985537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8c68-7b27-4ca9-bd3f-0973c08e7fcb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:08.985847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff8c68-7b27-4ca9-bd3f-0973c08e7fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:09.052526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ddff8c68-7b27-4ca9-bd3f-0973c08e7fcb None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:09.053763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ddff8c68-7b27-4ca9-bd3f-0973c08e7fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:09.112675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:09.151048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 652/1322] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:09.450274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:09.450671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:09.451012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:09.452470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 671/1323] 10.222.0.43 () {54 vars in 965 bytes} [Thu Sep 1 05:02:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:09.459535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c537-b251-4cde-855e-3ce591ea3f74 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:09.459821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c537-b251-4cde-855e-3ce591ea3f74 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:09.460097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f93c537-b251-4cde-855e-3ce591ea3f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:09.538887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9f93c537-b251-4cde-855e-3ce591ea3f74 None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:09.540105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f93c537-b251-4cde-855e-3ce591ea3f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:09.615252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 653/1324] 10.222.0.43 () {58 vars in 1062 bytes} [Thu Sep 1 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:02:09.624146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:09.625748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:09.650893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:09.735950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ff7a0-8845-4e66-b283-23fbdd11c908 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:09.808171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:09.808772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:09.809050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:09.809353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:09.810931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:09.882017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:09.919721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:09.921156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ebf26d-bfbe-4247-af4b-a690943dab98 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:09.939377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 672/1325] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:12.130479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:12.131063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:12.131063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:12.132409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 654/1326] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:12.137579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa250-f5c2-4eed-8414-ef2125faf87c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:12.138015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa250-f5c2-4eed-8414-ef2125faf87c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:12.138121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaa250-f5c2-4eed-8414-ef2125faf87c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:12.205921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a2eaa250-f5c2-4eed-8414-ef2125faf87c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:12.207031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2eaa250-f5c2-4eed-8414-ef2125faf87c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:12.307710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 673/1327] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:12.589637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:12.591187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:12.667807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:12.718316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3febec-f479-4fd2-a29b-fc1faf4c9040 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:12.793194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:12.793807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:12.794088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:12.794364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:12.795939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:12.903101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:12.905411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:12.907217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf1a05b-d70d-4c05-beeb-da78f5b77e94 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:12.927053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 655/1328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:14.884626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:14.885169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:14.885315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:14.886605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 674/1329] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:14.892001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5cc6-20fd-4898-af9c-477bdea6f640 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:14.892422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5cc6-20fd-4898-af9c-477bdea6f640 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:14.892638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce5cc6-20fd-4898-af9c-477bdea6f640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:14.974118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4fce5cc6-20fd-4898-af9c-477bdea6f640 None None] MFA Rules not processed for user `39a86a262916418689a8a39b9c57efca`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:14.975344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4fce5cc6-20fd-4898-af9c-477bdea6f640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:15.077824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 656/1330] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:15.362380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:15.363896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:15.394975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:15.467993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b332b101-aed1-453b-bff7-dba7df5e2762 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:15.541776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:15.542389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:15.542665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:15.542934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:15.544521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:15.628069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:15.663198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:15.664660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88a43ad-6a4f-481b-8f67-5aa6aaded870 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:15.690476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 675/1331] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:18.002428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:18.003003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:18.003222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:18.004601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 657/1332] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:18.009703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761770b-a81e-47ad-a706-90d85b1e6f19 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:18.010127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761770b-a81e-47ad-a706-90d85b1e6f19 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:18.010274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4761770b-a81e-47ad-a706-90d85b1e6f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:18.075486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4761770b-a81e-47ad-a706-90d85b1e6f19 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:18.076668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4761770b-a81e-47ad-a706-90d85b1e6f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:18.170336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 676/1333] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:18.460367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:18.461926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:18.529365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:18.562773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1852724-9229-4dd1-bf09-6648edae180a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:18.634504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:18.635106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:18.635383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:18.635655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:18.637250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:18.743736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:18.745086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608366d3-a9f9-41ed-bb70-ccd217a9ecd9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:18.754944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:18.763047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 658/1334] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:20.751056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:20.751627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:20.751627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:20.753646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 677/1335] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:20.758981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cb1a-9ba5-43f5-aa02-a95aeb2337fb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:20.759383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cb1a-9ba5-43f5-aa02-a95aeb2337fb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:20.759533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d2cb1a-9ba5-43f5-aa02-a95aeb2337fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:20.824529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8d2cb1a-9ba5-43f5-aa02-a95aeb2337fb None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:20.825776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8d2cb1a-9ba5-43f5-aa02-a95aeb2337fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:20.921208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 659/1336] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:21.205306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:21.207226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:21.247596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:21.310964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54088374-ce99-4775-867a-b841a3f001a6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:21.384340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:21.384938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:21.385238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:21.385515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:21.387102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:21.469411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:21.495945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:21.497413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430fb41a-9c93-48f2-be19-e2c75c375799 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:21.515122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 678/1337] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:23.871892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:23.872480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:23.872480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:23.873831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 660/1338] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:23.879629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b212e4-8aea-491f-95db-804631dba873 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:23.880063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b212e4-8aea-491f-95db-804631dba873 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:23.880163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b212e4-8aea-491f-95db-804631dba873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:23.945341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-49b212e4-8aea-491f-95db-804631dba873 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:23.946434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49b212e4-8aea-491f-95db-804631dba873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:24.040683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 679/1339] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:24.330170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:24.331718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:24.410868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:24.438903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b72dfb-52bf-429b-b88b-5d6c4ae7266d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:24.510290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:24.510885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:24.511161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:24.511432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:24.512990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:24.618811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:24.620248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2469581-97f9-4b8a-81d8-bfb86e02b6af service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:24.638220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 661/1340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:28.574450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:28.575034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:28.575034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:28.576330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 680/1341] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:28.582210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518fd4-80f6-40f3-9aca-592c80b45365 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:28.582675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518fd4-80f6-40f3-9aca-592c80b45365 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:28.582782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9518fd4-80f6-40f3-9aca-592c80b45365 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:28.588361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:28.650951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d9518fd4-80f6-40f3-9aca-592c80b45365 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:28.652188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d9518fd4-80f6-40f3-9aca-592c80b45365 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:28.754113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 662/1342] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:29.043435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:29.044984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:29.092889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:29.150338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57059078-3089-45ca-b16c-f0f3b50dde09 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:29.224635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:29.225265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:29.225548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:29.225824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:29.227405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:29.321903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:29.339279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:29.340722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d353a5-d80a-48c8-ac2a-ed10670cefa9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:29.359995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 681/1343] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:31.894006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:31.894507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:31.894599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:31.895912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 663/1344] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:31.901501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556705e2-00c8-473b-8643-0a6301063b71 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:31.902041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556705e2-00c8-473b-8643-0a6301063b71 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:31.902142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556705e2-00c8-473b-8643-0a6301063b71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:31.972510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-556705e2-00c8-473b-8643-0a6301063b71 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:31.973744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-556705e2-00c8-473b-8643-0a6301063b71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:32.071766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 682/1345] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:32.357984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:32.359517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:32.446875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:32.464341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40266ea3-1d86-4d1f-89a7-e09d40beb8ad None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:32.544128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:32.544761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:32.545060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:32.545365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:32.547056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:32.658850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:32.660290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c40c94-6b04-4d66-9fb6-ae2889df102f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:32.681244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 664/1346] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:36.581995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:36.582458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:36.582577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:36.583925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 683/1347] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:36.588981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dd549-4940-4460-9292-301b96296b0f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:36.589435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dd549-4940-4460-9292-301b96296b0f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:36.589571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3dd549-4940-4460-9292-301b96296b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:36.606764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:36.665278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fb3dd549-4940-4460-9292-301b96296b0f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:36.666516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fb3dd549-4940-4460-9292-301b96296b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:36.771227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 665/1348] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:37.055376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:37.056921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:37.117588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:37.163507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5321f9-8624-43e3-87a6-a6444aa5026d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:37.241342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:37.241962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:37.242330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:37.242636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:37.244376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:37.349885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:37.354125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:37.355558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde8d286-bb7d-4a77-b524-981a11ad8178 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:37.373837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 684/1349] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:42.376751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865f86-419f-440f-9579-93e2ed587fc0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:42.377439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865f86-419f-440f-9579-93e2ed587fc0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:42.377549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865f86-419f-440f-9579-93e2ed587fc0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:42.379209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 666/1350] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:02:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:42.384994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832e00-518a-46d5-9c05-85c744a77d05 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:42.384994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832e00-518a-46d5-9c05-85c744a77d05 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:42.385511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e832e00-518a-46d5-9c05-85c744a77d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:42.494043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e832e00-518a-46d5-9c05-85c744a77d05 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:42.496801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e832e00-518a-46d5-9c05-85c744a77d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:42.664983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 685/1351] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:02:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:46.769391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=59 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:47.098655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fee4-eefb-4f26-aefd-4d31ae9424c7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:47.098870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fee4-eefb-4f26-aefd-4d31ae9424c7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:47.099461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e7fee4-eefb-4f26-aefd-4d31ae9424c7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:47.100843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 667/1352] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:02:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:47.106097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66cb7-08fa-44a5-99aa-f498e75e9d75 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:47.106572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66cb7-08fa-44a5-99aa-f498e75e9d75 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:47.106656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f66cb7-08fa-44a5-99aa-f498e75e9d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:47.163091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:47.187821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-83f66cb7-08fa-44a5-99aa-f498e75e9d75 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:47.189053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83f66cb7-08fa-44a5-99aa-f498e75e9d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:47.304320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 686/1353] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:48.568827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39793e3-b189-4a09-99e6-999f1ba4f431 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:48.569387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39793e3-b189-4a09-99e6-999f1ba4f431 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:48.569387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39793e3-b189-4a09-99e6-999f1ba4f431 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:48.570773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 668/1354] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:02:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:48.576037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61890-b969-491c-a397-a8a0ac20c0ea None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:48.576481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61890-b969-491c-a397-a8a0ac20c0ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:48.576581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e61890-b969-491c-a397-a8a0ac20c0ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:48.653771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-16e61890-b969-491c-a397-a8a0ac20c0ea None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:48.654977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-16e61890-b969-491c-a397-a8a0ac20c0ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:48.696808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:48.768107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 687/1355] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:02:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:52.148402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c245-e77d-4f85-a7b7-c28a11d8b823 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:52.148954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c245-e77d-4f85-a7b7-c28a11d8b823 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:52.148954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b507c245-e77d-4f85-a7b7-c28a11d8b823 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:52.150335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 669/1356] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:52.155581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178973-b5a3-4b38-91d7-57b8eb372020 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:52.155988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178973-b5a3-4b38-91d7-57b8eb372020 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:52.156125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178973-b5a3-4b38-91d7-57b8eb372020 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:52.233941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-57178973-b5a3-4b38-91d7-57b8eb372020 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:52.235232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-57178973-b5a3-4b38-91d7-57b8eb372020 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:52.363595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 688/1357] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:52.666425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:52.666708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:52.667176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:52.668497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 670/1358] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 05:02:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:52.675560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32dd2-c1e8-4ad2-986b-26a32f65f6a2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:52.676050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32dd2-c1e8-4ad2-986b-26a32f65f6a2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:52.676274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d32dd2-c1e8-4ad2-986b-26a32f65f6a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:52.709050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:52.773479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-46d32dd2-c1e8-4ad2-986b-26a32f65f6a2 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:52.774666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-46d32dd2-c1e8-4ad2-986b-26a32f65f6a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:52.898799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 689/1359] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 05:02:52 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:52.906370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:52.908527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:53.071724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d77b987-9fe0-4958-b88d-88c282847271 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:53.152460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:53.196202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:53.196897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:53.197270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:53.197608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:53.199234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:53.294405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:53.296487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8938d571-9580-492c-9c8a-9748a11f7d0a service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:53.316094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 671/1360] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:55.468659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:55.469055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:55.470007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:55.471577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 690/1361] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:55.476729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041267c-2fed-4591-945f-107d2a9f386a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:55.477582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041267c-2fed-4591-945f-107d2a9f386a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:55.477873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041267c-2fed-4591-945f-107d2a9f386a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:55.550667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6041267c-2fed-4591-945f-107d2a9f386a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:55.551973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6041267c-2fed-4591-945f-107d2a9f386a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:55.592190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:55.656775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 672/1362] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:55.959639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:55.959639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:56.035124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:56.128493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff2d63-06f0-4cc2-a323-6d1466b7d843 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:56.247208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:56.247817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:56.248087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:56.248356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:56.249955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:56.274341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:56.354215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:56.355724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa38951-b11d-4b4e-95c1-013a812ef60e service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:56.376207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 691/1363] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:02:58.646636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988e59-0a37-4159-bc27-e1b04c6ff4ed None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:58.647187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988e59-0a37-4159-bc27-e1b04c6ff4ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:58.647187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf988e59-0a37-4159-bc27-e1b04c6ff4ed None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:58.648790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 673/1364] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:02:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:58.653942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17984-56a0-442a-a6f7-18aef2c02179 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:58.654340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17984-56a0-442a-a6f7-18aef2c02179 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:58.654642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf17984-56a0-442a-a6f7-18aef2c02179 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:58.726910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fdf17984-56a0-442a-a6f7-18aef2c02179 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:58.728292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fdf17984-56a0-442a-a6f7-18aef2c02179 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:58.844175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:58.856198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 692/1365] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:02:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:02:59.157178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:59.157933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:59.158249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:59.160760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 674/1366] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 05:02:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:02:59.168182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3c0dc-a956-4f07-8c32-9d5ca5449129 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:59.168471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3c0dc-a956-4f07-8c32-9d5ca5449129 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:59.170954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3c0dc-a956-4f07-8c32-9d5ca5449129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:59.253733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e6d3c0dc-a956-4f07-8c32-9d5ca5449129 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:02:59.254862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e6d3c0dc-a956-4f07-8c32-9d5ca5449129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:59.384484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 693/1367] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 05:02:59 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:02:59.393164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:02:59.394720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:59.561863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9bd7d-acbf-4dfa-bc69-aeffd586412b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:02:59.588873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:02:59.692394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:02:59.693156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:02:59.693468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:02:59.693747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:02:59.695371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:02:59.789897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:02:59.791509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548368e-aabe-48e7-a171-860878d613f2 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:02:59.811527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 675/1368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:02:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:00.381284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e1a4-76a0-4c00-b8f0-3c1671edafa8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:00.381820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e1a4-76a0-4c00-b8f0-3c1671edafa8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:00.381820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d2e1a4-76a0-4c00-b8f0-3c1671edafa8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:00.383408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 694/1369] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:00.388696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0c77-e995-471e-88f1-f4325564b08a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:00.388992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0c77-e995-471e-88f1-f4325564b08a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:00.389296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95f0c77-e995-471e-88f1-f4325564b08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:00.421936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:00.465863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e95f0c77-e995-471e-88f1-f4325564b08a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:00.467190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e95f0c77-e995-471e-88f1-f4325564b08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:00.573236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 676/1370] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:01.152054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:01.152054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:01.152054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:01.153501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 695/1371] 10.222.0.43 () {54 vars in 964 bytes} [Thu Sep 1 05:03:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:01.158837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41631ca-df19-4d67-8609-e223d6c4c0c2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:01.159310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41631ca-df19-4d67-8609-e223d6c4c0c2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:01.159404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41631ca-df19-4d67-8609-e223d6c4c0c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:01.239746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c41631ca-df19-4d67-8609-e223d6c4c0c2 None None] MFA Rules not processed for user `fec5602226564e6b95baf1ab9824ff0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:01.240856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c41631ca-df19-4d67-8609-e223d6c4c0c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:01.289437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:01.324011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 677/1372] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Sep 1 05:03:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:01.333661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:01.335435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:01.396155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:01.453650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e8b8a0-6740-4cad-acf8-264c7b1e8624 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:01.531443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:01.532478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:01.532969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:01.533477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:01.535373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:01.654224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:01.674432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:01.676179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5e387e-0a1a-41ee-9489-38aee00e0918 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:01.700975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 696/1373] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:01.814366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:01.814684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:01.814834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:01.816429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 678/1374] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:01.821657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89033-5c0f-4954-86a7-42daa5bbf63f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:01.821999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89033-5c0f-4954-86a7-42daa5bbf63f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:01.822137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd89033-5c0f-4954-86a7-42daa5bbf63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:01.893283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1bd89033-5c0f-4954-86a7-42daa5bbf63f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:01.894446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1bd89033-5c0f-4954-86a7-42daa5bbf63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:02.023354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 697/1375] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:02.320551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:02.322078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:02.475448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8c73-c67b-47d8-8548-6e822b8b95f1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:02.525924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:02.588097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:02.588616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:02.588892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:02.589159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:02.590751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:02.680699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:02.682335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18cf4f1-39ce-47cf-ab1a-a220ee247ad1 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:02.700366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 679/1376] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:03:04.681590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:04.682101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:04.682196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:04.683637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 698/1377] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:04.689744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0263d-7e00-4e41-aad2-3c0b9d6fc2d2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:04.690138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0263d-7e00-4e41-aad2-3c0b9d6fc2d2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:04.690419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f0263d-7e00-4e41-aad2-3c0b9d6fc2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:04.768273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d4f0263d-7e00-4e41-aad2-3c0b9d6fc2d2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:04.769785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4f0263d-7e00-4e41-aad2-3c0b9d6fc2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:04.777173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:04.884767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 680/1378] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:05.173756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:05.175359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:05.270023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:05.382123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011c7e0e-f0be-4b98-8bc4-676d0f6fa9af None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:05.508624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:05.509145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:05.509446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:05.509712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:05.511270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:05.532643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:05.611248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:05.613099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f474a4-741e-4513-b94b-386f523f5822 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:05.633513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 699/1379] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:07.607256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:07.607768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:07.607768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:07.609732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 681/1380] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:07.615089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fd2cd-63a9-4b99-96d2-80bb529df7ea None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:07.615541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fd2cd-63a9-4b99-96d2-80bb529df7ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:07.615624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48fd2cd-63a9-4b99-96d2-80bb529df7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:07.685322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e48fd2cd-63a9-4b99-96d2-80bb529df7ea None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:07.686519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e48fd2cd-63a9-4b99-96d2-80bb529df7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:07.779632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:07.786597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 700/1381] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:08.083999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:08.085547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:08.238950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:08.251189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f59e27-1df1-41fa-89f1-8a739a906446 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:08.380586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:08.381427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:08.381698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:08.381972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:08.384144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:08.477558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:08.479236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd52d6c6-312b-4a6d-815e-38a818cac59f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:08.490866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:08.500601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 682/1382] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:10.618397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:10.618962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:10.619080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:10.620766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 701/1383] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:10.626175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fcf2c-91a6-40be-bf0a-f757fb0398c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:10.626616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fcf2c-91a6-40be-bf0a-f757fb0398c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:10.626711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16fcf2c-91a6-40be-bf0a-f757fb0398c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:10.697621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e16fcf2c-91a6-40be-bf0a-f757fb0398c3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:10.699117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e16fcf2c-91a6-40be-bf0a-f757fb0398c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:10.805920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 683/1384] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:03:11.099819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:11.101367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:11.279337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778b4962-d8b1-4e49-80bc-891516326c51 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:11.353839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:11.415736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:11.416345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:11.416625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:11.416894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:11.418532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:11.510186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:11.511817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eecfda-5ebf-4192-b59c-74335e916347 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:11.531464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 702/1385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:13.473485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:13.474047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:13.474047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:13.475345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 684/1386] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:03:13.480906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b704-f8c9-4696-80b1-6f53cfc1dc59 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:13.481368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b704-f8c9-4696-80b1-6f53cfc1dc59 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:13.481480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021b704-f8c9-4696-80b1-6f53cfc1dc59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:13.550118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c021b704-f8c9-4696-80b1-6f53cfc1dc59 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:13.551348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c021b704-f8c9-4696-80b1-6f53cfc1dc59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:13.585714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:13.657117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 703/1387] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:13.951413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:13.953575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:14.036743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:14.113371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c3d04-478d-4bbb-9cec-bf1cabec56ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:14.239229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:14.240330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:14.240604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:14.240875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:14.242516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:14.282138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:14.345993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:14.348083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88e6186-1e25-4bec-9aa3-9149b6ff098d service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:14.368139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 685/1388] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:16.326662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:16.327188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:16.327188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:16.328545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 704/1389] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:16.333762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85abef-afad-4e9d-a52d-95476f150929 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:16.334169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85abef-afad-4e9d-a52d-95476f150929 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:16.334278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb85abef-afad-4e9d-a52d-95476f150929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:16.399283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cb85abef-afad-4e9d-a52d-95476f150929 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:16.400466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb85abef-afad-4e9d-a52d-95476f150929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:16.495698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 686/1390] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:16.791011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:16.792577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:16.796955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1461b-6c23-4d0d-a5e8-5dca2fdae78b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:16.797272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1461b-6c23-4d0d-a5e8-5dca2fdae78b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:16.797548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf1461b-6c23-4d0d-a5e8-5dca2fdae78b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:16.798881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 687/1391] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:03:16.803711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e759-41e9-4ab4-9b0d-c06afe8e816a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:16.804019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e759-41e9-4ab4-9b0d-c06afe8e816a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:16.804309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803e759-41e9-4ab4-9b0d-c06afe8e816a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:16.820145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:16.872177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d803e759-41e9-4ab4-9b0d-c06afe8e816a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:16.873472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d803e759-41e9-4ab4-9b0d-c06afe8e816a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:16.948238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb801b0-200b-4fa1-ad4c-2993d81b6171 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:16.964606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:16.974060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 688/1392] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:03:17.063810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:17.064355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:17.064631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:17.064900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:17.066538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:17.154189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:17.156411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf1e74-8252-4f1c-ac85-06fcc6d990a3 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:17.174476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 705/1393] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:17.288861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:17.289132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:17.289440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:17.290912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 689/1394] 10.222.0.43 () {54 vars in 967 bytes} [Thu Sep 1 05:03:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:17.296954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1355-05e7-4978-8773-a28197cb902e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:17.297420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1355-05e7-4978-8773-a28197cb902e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:17.297541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37f1355-05e7-4978-8773-a28197cb902e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:17.324881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:17.385654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a37f1355-05e7-4978-8773-a28197cb902e None None] MFA Rules not processed for user `b1e3deabee4f46cb9e0c15f94e5ab23d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:17.387041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a37f1355-05e7-4978-8773-a28197cb902e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:17.463197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 706/1395] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Sep 1 05:03:17 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:17.471636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:17.473262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:17.575663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:17.583014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f6dcdd-8c76-4254-a952-932925329e28 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:17.655047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:17.656209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:17.656485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:17.656831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:17.658438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:17.767950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:17.769472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc363c-16f8-4b47-ba50-2cde54b94e92 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:17.787645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 690/1396] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:18.524048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ebf4-9628-45c0-b211-1015593357b4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:18.524562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ebf4-9628-45c0-b211-1015593357b4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:18.524667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f9ebf4-9628-45c0-b211-1015593357b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:18.592241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-13f9ebf4-9628-45c0-b211-1015593357b4 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:18.594001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-13f9ebf4-9628-45c0-b211-1015593357b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:18.652494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:18.682915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 707/1397] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:03:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:18.726192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:18.726689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:18.726878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:18.728289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 691/1398] 10.222.0.43 () {54 vars in 943 bytes} [Thu Sep 1 05:03:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:18.734695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f558ad-91aa-4209-9164-579c4cb2f466 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:18.734982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f558ad-91aa-4209-9164-579c4cb2f466 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:18.735366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f558ad-91aa-4209-9164-579c4cb2f466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:18.812261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-16f558ad-91aa-4209-9164-579c4cb2f466 None None] MFA Rules not processed for user `ba26775b8b3c49ae878e8ca696c3cda5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:18.813874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-16f558ad-91aa-4209-9164-579c4cb2f466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:18.920673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 708/1399] 10.222.0.43 () {58 vars in 1040 bytes} [Thu Sep 1 05:03:18 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:03:18.930227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:18.931756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:18.956640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:19.069924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79b50ee-ced8-4e39-9fea-609910109242 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:19.135339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86b72-79f3-4baa-880c-c35807fb7485 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:19.135625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86b72-79f3-4baa-880c-c35807fb7485 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:19.135902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f86b72-79f3-4baa-880c-c35807fb7485 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:19.137315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 709/1400] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:03:19.142921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807b69a-eb28-4501-b226-325c514e8e41 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:19.143199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807b69a-eb28-4501-b226-325c514e8e41 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:19.143471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9807b69a-eb28-4501-b226-325c514e8e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:19.175035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:19.175636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:19.175913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:19.176180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:19.178044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:19.186071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:19.199826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:19.224726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9807b69a-eb28-4501-b226-325c514e8e41 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:19.225978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9807b69a-eb28-4501-b226-325c514e8e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:19.267459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:19.269055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:19.277213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 692/1401] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:03:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:03:19.331722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 710/1402] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:03:19.627999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:19.630772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:19.737600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c12edc-60bc-47cc-973d-59e5e3aa9475 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:19.798965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:19.869963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:19.870834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:19.871109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:19.871383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:19.872981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:19.975800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:19.977423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd3df73-f0ba-4d12-ae6a-c7fc8214c8e4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:19.999842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 693/1403] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:22.018343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:22.018877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:22.018877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:22.020388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 711/1404] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:22.030371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea20bf-f5e3-4e93-9946-8934ce4397c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:22.031493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea20bf-f5e3-4e93-9946-8934ce4397c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:22.031682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ea20bf-f5e3-4e93-9946-8934ce4397c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:22.106102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f5ea20bf-f5e3-4e93-9946-8934ce4397c3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:22.107339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f5ea20bf-f5e3-4e93-9946-8934ce4397c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:22.125485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:22.217232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 694/1405] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:22.529888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:22.531750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:22.654928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:22.696777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e043b-073f-428e-bb47-46581f71b88b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:22.819514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:22.820184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:22.820495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:22.820680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:22.822304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:22.908026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:22.927138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:22.928761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959a5429-b06b-4482-95e1-cabf0b03099a service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:22.957722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 712/1406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:24.961566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:24.962032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:24.962140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:24.963899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 695/1407] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:24.971661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb909-1ee4-4181-b257-ded8d8218839 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:24.972086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb909-1ee4-4181-b257-ded8d8218839 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:24.972241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bbb909-1ee4-4181-b257-ded8d8218839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:25.048882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-99bbb909-1ee4-4181-b257-ded8d8218839 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:25.050134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-99bbb909-1ee4-4181-b257-ded8d8218839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:25.161487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 713/1408] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:03:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:25.459881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:25.460766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:25.632218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:25.635006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4176f473-a400-44a0-90ad-468e255355f0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:25.760348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:25.760952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:25.761268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:25.761544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:25.763110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:25.863363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:25.864966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6199bc7-0a03-44c3-96f6-bd45b51efea8 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:25.886888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 696/1409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:35.159308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=76 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:35.884346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:41.774664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868edd-d4f3-4bda-ba12-f50950999574 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:41.775219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868edd-d4f3-4bda-ba12-f50950999574 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:41.775219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2868edd-d4f3-4bda-ba12-f50950999574 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:41.776578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 714/1410] 10.222.0.43 () {54 vars in 918 bytes} [Thu Sep 1 05:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:41.782200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ec7e-71b7-47bb-8e76-282727f820c1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:41.782588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ec7e-71b7-47bb-8e76-282727f820c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:41.782759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca26ec7e-71b7-47bb-8e76-282727f820c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:41.857422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca26ec7e-71b7-47bb-8e76-282727f820c1 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:41.859326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca26ec7e-71b7-47bb-8e76-282727f820c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:41.967893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 697/1411] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:41.981863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd38e-7c07-424d-affb-ed3fab08397e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:41.982211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd38e-7c07-424d-affb-ed3fab08397e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:41.982549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ffd38e-7c07-424d-affb-ed3fab08397e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:41.984601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 715/1412] 10.222.0.43 () {54 vars in 918 bytes} [Thu Sep 1 05:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:41.989381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093eeca-733c-4810-b738-c1f5fa08d462 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:41.989670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093eeca-733c-4810-b738-c1f5fa08d462 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:41.989945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8093eeca-733c-4810-b738-c1f5fa08d462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:42.063167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:42.066233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8093eeca-733c-4810-b738-c1f5fa08d462 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:42.068001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8093eeca-733c-4810-b738-c1f5fa08d462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:42.182420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 698/1413] 10.222.0.43 () {58 vars in 1015 bytes} [Thu Sep 1 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:44.571886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:44.572418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:44.572418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:44.573709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 716/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:03:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:44.578907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32233-97fa-4c61-b551-b88f07c45e12 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:44.579297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32233-97fa-4c61-b551-b88f07c45e12 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:44.579460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed32233-97fa-4c61-b551-b88f07c45e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:44.644166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eed32233-97fa-4c61-b551-b88f07c45e12 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:44.645393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eed32233-97fa-4c61-b551-b88f07c45e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:44.700157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:44.742331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 699/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:03:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:45.027085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:45.028575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:45.172013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa177e6-9e5b-4964-a6f3-1dd170390c17 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:45.243378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:45.284686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:45.285315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:45.285597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:45.285903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:45.287506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:45.379785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:45.381419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247f448a-d4af-46ac-bca7-4cdfde2c1a1f service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:45.398960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 717/1416] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:46.293746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:46.294288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:46.294288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:46.296384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 700/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:46.301249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14499-d672-4a7a-a707-4931a7b24318 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:46.301673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14499-d672-4a7a-a707-4931a7b24318 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:46.301794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd14499-d672-4a7a-a707-4931a7b24318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:46.376743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8dd14499-d672-4a7a-a707-4931a7b24318 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:46.378025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8dd14499-d672-4a7a-a707-4931a7b24318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:46.404927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:46.473604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 718/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:46.624819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:46.626338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:46.769159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2416ceff-0c98-4865-9e3a-792acdbbbf00 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:46.808040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:46.879842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:46.880356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:46.880632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:46.880900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:46.882498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:46.972141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:46.973798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee08b-c22e-4a31-baa9-dffa083f168b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:46.991671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 701/1419] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:47.877872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:47.878397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:47.878397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:47.879780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 719/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:47.884653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe640-2fa3-48af-a5f5-56383fe404c0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:47.885057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe640-2fa3-48af-a5f5-56383fe404c0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:47.885379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-232fe640-2fa3-48af-a5f5-56383fe404c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:47.939794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:47.966229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-232fe640-2fa3-48af-a5f5-56383fe404c0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:47.968024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-232fe640-2fa3-48af-a5f5-56383fe404c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:48.063968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 702/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:48.216143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:48.219443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:48.366400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da4a89-8a0e-43e4-a84d-500e251e1d15 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:48.378885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:48.478026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:48.478579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:48.478856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:48.479126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:48.480732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:48.572637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:48.574264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ebc2-f0f5-4758-aa82-a29046c63c0e service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:48.592391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 720/1422] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:49.455577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:49.456151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:49.456151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:49.457514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 703/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:49.462470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ac80-947b-41ae-a84f-c2b05b35d8c4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:49.462902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ac80-947b-41ae-a84f-c2b05b35d8c4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:49.463090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac34ac80-947b-41ae-a84f-c2b05b35d8c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:49.482797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:49.539723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ac34ac80-947b-41ae-a84f-c2b05b35d8c4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:49.540933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac34ac80-947b-41ae-a84f-c2b05b35d8c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:49.635911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 721/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:49.787646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:49.789161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:49.903038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:49.942386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c2d8-5085-48d6-80cb-946b7a0ccead None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:50.055044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:50.055553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:50.055827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:50.056092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:50.057674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:50.133009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:50.147039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:50.148625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a3923e-4e5f-4d80-a2d6-4329ab5b6190 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:50.166089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 704/1425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:51.035346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:51.035875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:51.035875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:51.037248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 722/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:51.042153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848143-d70f-4bc3-871f-244f24a63d42 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:51.042577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848143-d70f-4bc3-871f-244f24a63d42 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:51.042704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b848143-d70f-4bc3-871f-244f24a63d42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:51.117254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4b848143-d70f-4bc3-871f-244f24a63d42 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:51.118478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4b848143-d70f-4bc3-871f-244f24a63d42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:51.211640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 705/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:51.362016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:51.363556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:51.447263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:51.509260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98e5173-6e86-45ca-9663-d3ef2e39379e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:51.619877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:51.620476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:51.620753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:51.621030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:51.622659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:51.670189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:51.711683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:51.712886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d176d4c-c27d-44e2-96fa-8aecf4ac8da2 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:51.730576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 723/1428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:52.533782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:52.534351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:52.534351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:52.535664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 706/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:52.540633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec1f2-7524-48e0-a2f5-1a8062ca4e92 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:52.541040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec1f2-7524-48e0-a2f5-1a8062ca4e92 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:52.541206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eec1f2-7524-48e0-a2f5-1a8062ca4e92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:52.619719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-61eec1f2-7524-48e0-a2f5-1a8062ca4e92 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:52.620914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61eec1f2-7524-48e0-a2f5-1a8062ca4e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:52.714524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 724/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:52.867553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:52.869106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:52.916499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:53.014081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9975342a-8da0-4016-8c24-d39c9fe169c4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:53.129344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:53.129875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:53.130156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:53.130430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:53.132026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:53.139741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:53.220959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:53.222581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0dd02d-3ded-4982-be40-60aa28653fb5 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:53.240847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 707/1431] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:54.045393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:54.045951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:54.045951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:54.047187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 725/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:54.052162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc9f7-f488-4326-8272-bde92cd6eecd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:54.052619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc9f7-f488-4326-8272-bde92cd6eecd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:54.052730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfadc9f7-f488-4326-8272-bde92cd6eecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:54.128174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bfadc9f7-f488-4326-8272-bde92cd6eecd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:54.129400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bfadc9f7-f488-4326-8272-bde92cd6eecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:54.196860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:54.225541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 708/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:54.377871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:54.379376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:54.396775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:54.524145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e218ce-a1b0-44f2-86ef-85cc020dad1f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:54.614712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:54.642199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:54.642743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:54.643019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:54.643298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:54.644898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:54.733072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:54.734699 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f7d5fd-4152-44a3-9728-f96ab77473a1 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:54.753555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 726/1434] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:55.554093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:55.554656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:55.554656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:55.555991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 709/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:55.561580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04101fd-0031-49ad-91a5-e16ed271dfdd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:55.562040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04101fd-0031-49ad-91a5-e16ed271dfdd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:55.562148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04101fd-0031-49ad-91a5-e16ed271dfdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:55.637255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c04101fd-0031-49ad-91a5-e16ed271dfdd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:55.638603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c04101fd-0031-49ad-91a5-e16ed271dfdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:55.679012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:55.734126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 727/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:55.882661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:55.884206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:56.031044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a16422a-02f6-4877-85ca-d1c6a3053319 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:56.083678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:56.142815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:56.143423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:56.143703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:56.143976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:56.145610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:56.233401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:56.234955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4468d1-9b0a-4ce2-a4cd-cca3a9ce8881 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:56.252678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 710/1437] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:57.056093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:57.056685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:57.056685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:57.058008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 728/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:03:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:57.063519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82125-1b60-4422-a277-503880336133 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:57.063958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82125-1b60-4422-a277-503880336133 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:57.064075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e82125-1b60-4422-a277-503880336133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:57.139989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-78e82125-1b60-4422-a277-503880336133 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:57.141257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-78e82125-1b60-4422-a277-503880336133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:57.143363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:57.236797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 711/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:03:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:03:57.387629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:03:57.389803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:57.531318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86657201-1b54-4083-87bb-8dd1411707a5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:03:57.557962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:57.643134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:03:57.643730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:57.644004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:57.644271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:57.645872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:57.732930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:03:57.734587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7e2a8d-36b2-43a0-a8b5-551c1a7e567c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:03:57.752872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 729/1440] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:03:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:03:59.607378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:59.607953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:59.607953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:59.609523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 712/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:03:59.614895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527d2e-ffea-4113-b81c-487e40eec112 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:03:59.615338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527d2e-ffea-4113-b81c-487e40eec112 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:03:59.615437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e527d2e-ffea-4113-b81c-487e40eec112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:03:59.656933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:03:59.682037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5e527d2e-ffea-4113-b81c-487e40eec112 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:03:59.683226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5e527d2e-ffea-4113-b81c-487e40eec112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:03:59.778107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 730/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:03:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:00.061539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:00.063061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:00.164653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cb02f7-a3d1-41b2-a394-debd85cb79ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:00.195699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:00.237761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:00.238289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:00.238564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:00.238833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:00.240391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:00.355432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:00.357405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a1a87c-903d-43dc-84ab-baec73172ad4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:00.375555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 713/1443] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:04:02.419740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:02.420309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:02.420421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:02.421816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 731/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:02.427003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093fe2-8a2f-4d89-88b0-72b077f0fef4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:02.427427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093fe2-8a2f-4d89-88b0-72b077f0fef4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:02.427524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a093fe2-8a2f-4d89-88b0-72b077f0fef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:02.492614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a093fe2-8a2f-4d89-88b0-72b077f0fef4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:02.493840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a093fe2-8a2f-4d89-88b0-72b077f0fef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:02.507014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:02.589020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 714/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:02.874482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:02.876030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:02.979152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf679b43-f82c-4ca6-9b44-b775b282ed8f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:02.992173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:03.058879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:03.059508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:03.060612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:03.060612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:03.062331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:03.177932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:03.179379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc096232-801e-4bb8-a9c0-d26a249310b7 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:03.197891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 732/1446] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:05.410985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:05.411540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:05.411540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:05.412858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 715/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:05.417956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c015e-93fe-460e-843f-dfa971ca23d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:05.418379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c015e-93fe-460e-843f-dfa971ca23d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:05.418482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360c015e-93fe-460e-843f-dfa971ca23d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:05.465728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:05.485981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-360c015e-93fe-460e-843f-dfa971ca23d3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:05.487180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-360c015e-93fe-460e-843f-dfa971ca23d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:05.582236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 733/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:05.862305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:05.863839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:05.966832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0eae03-858c-4679-8d75-a8810e2fd47a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:06.006584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:06.039329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:06.039930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:06.040212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:06.040486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:06.042074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:06.149285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:06.150721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d976efd-7b06-4988-81e9-8cd7e88baf86 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:06.168574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 716/1449] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:08.179574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:08.180137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:08.180137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:08.181471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 734/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:08.187412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ad2ec-0553-452e-aabd-32fba9384b28 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:08.187818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ad2ec-0553-452e-aabd-32fba9384b28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:08.187967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ad2ec-0553-452e-aabd-32fba9384b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:08.254790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-272ad2ec-0553-452e-aabd-32fba9384b28 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:08.255996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-272ad2ec-0553-452e-aabd-32fba9384b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:08.278008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:08.355128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 717/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:08.638100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:08.639674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:08.743250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da30f140-ffb4-47bc-a43d-bc9241a9c133 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:08.763238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:08.816896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:08.817540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:08.817849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:08.818128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:08.819717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:08.926590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:08.927941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7976e2fb-a9c5-4faa-bcb8-05a97d574235 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:08.946416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 735/1452] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:10.892745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:10.893347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:10.893347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:10.894654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 718/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:10.899734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6c2b7-7720-4953-b43c-73247c37ca09 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:10.900164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6c2b7-7720-4953-b43c-73247c37ca09 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:10.900273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba6c2b7-7720-4953-b43c-73247c37ca09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:10.965478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:10.969092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4ba6c2b7-7720-4953-b43c-73247c37ca09 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:10.970929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ba6c2b7-7720-4953-b43c-73247c37ca09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:11.066726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 736/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:11.350183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:11.351727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:11.453820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36beb43d-5a02-4515-b832-608a05067be1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:11.500892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:11.525568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:11.526172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:11.526453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:11.526729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:11.528942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:11.635661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:11.637089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0f365-c9e8-473f-af0b-072dd5f60d0d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:11.655978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 719/1455] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:13.685428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:13.685985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:13.685985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:13.687323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 737/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:13.692538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd0b0-19b8-4930-a825-440a207c4932 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:13.692951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd0b0-19b8-4930-a825-440a207c4932 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:13.693153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2bd0b0-19b8-4930-a825-440a207c4932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:13.763008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1f2bd0b0-19b8-4930-a825-440a207c4932 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:13.764219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f2bd0b0-19b8-4930-a825-440a207c4932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:13.793803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:13.860268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 720/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:14.154314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:14.156693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:14.260423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ff9b58-4f89-4da5-b794-182b49b50224 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:14.288143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:14.334890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:14.335486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:14.335760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:14.336030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:14.337625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:14.444883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:14.446342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7966a4ea-54b8-49f5-bc65-ee11eedcb8e5 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:14.464105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 738/1458] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:16.407134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:16.407696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:16.407696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:16.409030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 721/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:16.414470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733c56-936a-4073-8d94-8653dfefe66f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:16.414870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733c56-936a-4073-8d94-8653dfefe66f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:16.415030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79733c56-936a-4073-8d94-8653dfefe66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:16.480524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-79733c56-936a-4073-8d94-8653dfefe66f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:16.482272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79733c56-936a-4073-8d94-8653dfefe66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:16.490578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:16.578147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 739/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:16.859308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:16.861097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:16.962771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4afb6c-a277-4d9a-bb54-3e83be278898 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:17.016764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:17.035637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:17.036241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:17.036520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:17.036800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:17.038405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:17.144314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:17.145783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6098cf7d-a7f5-496d-b8ed-d13bd6a4ac93 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:17.164037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 722/1461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:19.133338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:19.133897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:19.133897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:19.135206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 740/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:19.140606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8276-bc92-4c83-a9be-f11bd6c87281 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:19.141036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8276-bc92-4c83-a9be-f11bd6c87281 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:19.141159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa8276-bc92-4c83-a9be-f11bd6c87281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:19.206406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fefa8276-bc92-4c83-a9be-f11bd6c87281 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:19.207525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fefa8276-bc92-4c83-a9be-f11bd6c87281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:19.245987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:19.303852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 723/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:19.585853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:19.587431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:19.689833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f9bb0e-32ec-4746-ac3b-eaf2ad3cbb06 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:19.725686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:19.762497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:19.763102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:19.763384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:19.763657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:19.765268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:19.872638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:19.874103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7595ce-1af2-477c-9d2e-07fb8c425b99 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:19.891723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 741/1464] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:21.800150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:21.800697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:21.800697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:21.802060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 724/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:21.807158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a667-0ef8-44cb-900d-ff4a136bed36 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:21.807587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a667-0ef8-44cb-900d-ff4a136bed36 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:21.807783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f62a667-0ef8-44cb-900d-ff4a136bed36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:21.873874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9f62a667-0ef8-44cb-900d-ff4a136bed36 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:21.875062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9f62a667-0ef8-44cb-900d-ff4a136bed36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:21.893077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:21.971752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 742/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:22.256831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:22.258403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:22.480604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26dd546d-5a45-4748-9c3f-5a539a517097 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:22.545865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:22.552836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:22.553467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:22.553739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:22.554002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:22.555552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:22.660206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:22.661639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b788ec-fd52-4016-af19-cde5f5f29b23 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:22.679433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 725/1467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:24.645606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:24.646195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:24.646195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:24.647511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 743/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:04:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:24.652923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079ccf-ca5c-4980-822a-a8b9abe9e63f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:24.653408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079ccf-ca5c-4980-822a-a8b9abe9e63f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:24.653516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92079ccf-ca5c-4980-822a-a8b9abe9e63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:24.717207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-92079ccf-ca5c-4980-822a-a8b9abe9e63f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:24.718417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92079ccf-ca5c-4980-822a-a8b9abe9e63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:24.768395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:24.815777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 726/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:04:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:25.102478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:25.103987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:25.207037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122fdf25-ce74-4280-b953-3d35a55bee97 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:25.253680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:25.280627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:25.281258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:25.281540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:25.281812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:25.283402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:25.392221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:25.393732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20b21ae-d788-4353-901a-d3835a6d3237 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:25.411874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 744/1470] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:34.814017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=22 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:35.409551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=66 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:44.938639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a540-1496-48d7-ac50-9ad1cf6a0cb8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:44.939207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a540-1496-48d7-ac50-9ad1cf6a0cb8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:44.939207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0524a540-1496-48d7-ac50-9ad1cf6a0cb8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:44.940532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 727/1471] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:44.945791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf20b7-1425-4f38-8ad2-244fbc8e801e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:44.946206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf20b7-1425-4f38-8ad2-244fbc8e801e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:44.946455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bf20b7-1425-4f38-8ad2-244fbc8e801e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:45.012321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b1bf20b7-1425-4f38-8ad2-244fbc8e801e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:45.013543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1bf20b7-1425-4f38-8ad2-244fbc8e801e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:45.111448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 745/1472] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:45.409947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:45.410239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:45.410516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:45.411838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 728/1473] 10.222.0.43 () {54 vars in 967 bytes} [Thu Sep 1 05:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:45.416796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099541-b260-447e-a3e3-eeaf2cd10fb0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:45.417083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099541-b260-447e-a3e3-eeaf2cd10fb0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:45.418055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22099541-b260-447e-a3e3-eeaf2cd10fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:45.493140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-22099541-b260-447e-a3e3-eeaf2cd10fb0 None None] MFA Rules not processed for user `b1e3deabee4f46cb9e0c15f94e5ab23d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:45.494361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-22099541-b260-447e-a3e3-eeaf2cd10fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:45.515023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:45.570807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 746/1474] 10.222.0.43 () {58 vars in 1064 bytes} [Thu Sep 1 05:04:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:45.578438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:45.579951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:45.682577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec7bd3e-88fe-499e-a59a-ebf66e284cb0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:45.753825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:45.754424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:45.754700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:45.754971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:45.756529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:45.809305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:45.862577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:45.863995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8784f7-e267-44d5-b199-ef866a22c085 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:45.882374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 729/1475] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:47.887986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:47.888551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:47.888551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:47.889914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 747/1476] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:47.895154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0c09-96ca-4d6d-886c-0bb8994f1d8f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:47.895579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0c09-96ca-4d6d-886c-0bb8994f1d8f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:47.895690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cb0c09-96ca-4d6d-886c-0bb8994f1d8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:47.961689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e7cb0c09-96ca-4d6d-886c-0bb8994f1d8f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:47.962895 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e7cb0c09-96ca-4d6d-886c-0bb8994f1d8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:48.057539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 730/1477] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:48.330891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:48.332327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:48.454702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe2e432-91d2-45f4-9083-1175f034c86d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:48.502766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:48.548010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:48.548617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:48.548895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:48.549172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:48.549833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:48.551607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:04:48.551607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:04:48.551607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:04:48.552767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc515cb8-62b3-4508-b73b-14a9871a1526 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:48.572192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 748/1478] 10.222.0.43 () {56 vars in 1108 bytes} [Thu Sep 1 05:04:48 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:04:50.509778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3452-e065-48da-a5e6-85264190367a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:50.510360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3452-e065-48da-a5e6-85264190367a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:50.510360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94b3452-e065-48da-a5e6-85264190367a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:50.512425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 731/1479] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:50.517688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b170-4679-46d0-abc3-c65372e44c84 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:50.518148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b170-4679-46d0-abc3-c65372e44c84 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:50.518253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b2b170-4679-46d0-abc3-c65372e44c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:50.584340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-63b2b170-4679-46d0-abc3-c65372e44c84 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:50.585569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-63b2b170-4679-46d0-abc3-c65372e44c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:50.680108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 749/1480] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:50.978625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3452-e065-48da-a5e6-85264190367a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:50.980677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d94b3452-e065-48da-a5e6-85264190367a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:50.993866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:51.126142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94b3452-e065-48da-a5e6-85264190367a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:51.202504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:51.235042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:51.235635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:51.235908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:51.236175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:51.237766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:51.323254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:51.325630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265d3bd-e57f-435f-8109-62c76d6d24c4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:51.347344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 732/1481] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:04:53.425829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:53.426365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:53.426365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:53.427786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 750/1482] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:53.433139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57e4e-ef00-4fc5-a905-f76120f83c55 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:53.433660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57e4e-ef00-4fc5-a905-f76120f83c55 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:53.433767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d57e4e-ef00-4fc5-a905-f76120f83c55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:53.498199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05d57e4e-ef00-4fc5-a905-f76120f83c55 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:53.499403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05d57e4e-ef00-4fc5-a905-f76120f83c55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:53.544482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:53.594893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 733/1483] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:53.876827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:53.878455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:53.903420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:53.984154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1064cd1-8097-411b-8e24-c0f24eb8963a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:54.057357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:54.058412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:54.058749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:54.058992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:54.060555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:54.133401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:54.169703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:54.171139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5f4a60-f2b9-4d05-9141-f344b6ec71bf service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:54.189724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 751/1484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:56.115651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:56.116232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:56.116232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:56.117602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 734/1485] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:56.123223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1694c-4b9f-477e-a966-bca64c718f8a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:56.123678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1694c-4b9f-477e-a966-bca64c718f8a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:56.123782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1694c-4b9f-477e-a966-bca64c718f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:56.189598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-09d1694c-4b9f-477e-a966-bca64c718f8a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:56.190786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09d1694c-4b9f-477e-a966-bca64c718f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:56.284444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 752/1486] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:04:56.569505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:56.571033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:56.672571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0c9c95-230c-40de-be9e-b6aa5da203e7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:56.741718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:56.743558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:56.744165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:56.744644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:56.745658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:56.747616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:56.853290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:56.855317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0694b3-378b-408e-8c50-b799b2e13e7d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:56.874282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 735/1487] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:04:58.863564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:58.864133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:58.864133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:58.865488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 753/1488] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:04:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:04:58.870839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980430-bb3f-42e0-9da6-87b3e697d595 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:58.871311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980430-bb3f-42e0-9da6-87b3e697d595 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:58.871421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a980430-bb3f-42e0-9da6-87b3e697d595 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:58.941197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a980430-bb3f-42e0-9da6-87b3e697d595 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:04:58.942391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a980430-bb3f-42e0-9da6-87b3e697d595 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:58.994634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:59.037714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 736/1489] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:04:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:04:59.327979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:04:59.329541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:59.365110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:59.431610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66708da6-988b-4ead-9b25-79e1bbe55389 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:04:59.506305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:04:59.506904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:04:59.507180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:04:59.507449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:04:59.509010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:04:59.707387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:04:59.736149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:04:59.737605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0155312c-f953-46c5-86ef-e3754d589ad2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:04:59.755708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 754/1490] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:05:01.841448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:01.841975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:01.842197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:01.843544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 737/1491] 10.222.0.43 () {54 vars in 927 bytes} [Thu Sep 1 05:05:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:05:01.848784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82e6b-ff7d-4038-bdad-431bb6c52a27 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:01.849226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82e6b-ff7d-4038-bdad-431bb6c52a27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:01.849343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c82e6b-ff7d-4038-bdad-431bb6c52a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:01.913320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-54c82e6b-ff7d-4038-bdad-431bb6c52a27 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:05:01.914504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54c82e6b-ff7d-4038-bdad-431bb6c52a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:02.009142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 755/1492] 10.222.0.43 () {58 vars in 1024 bytes} [Thu Sep 1 05:05:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:05:02.314018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:05:02.315548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:02.422129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c9d5d1-1db4-469f-b76c-c5c7c842affc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:05:02.500716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:05:02.501346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:05:02.501627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:05:02.501904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:05:02.503477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:05:02.512388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:02.611849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:05:02.613294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1656f8a9-780c-48d1-90eb-62ae9d7f7b9b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:05:02.630643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 738/1493] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:05:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:05:12.007375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=82 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:05:12.628385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=50 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.029508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.030025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.030132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.104125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:15.105362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.201769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 756/1494] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:06:15.209678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770a8d-a193-43b6-924c-047315976ffb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.210185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770a8d-a193-43b6-924c-047315976ffb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.210284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89770a8d-a193-43b6-924c-047315976ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.285332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-89770a8d-a193-43b6-924c-047315976ffb None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:15.286524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-89770a8d-a193-43b6-924c-047315976ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.380796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 739/1495] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:06:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:06:15.386098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.387302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.398504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c116d8-f2df-45b6-8881-0bd4cbc1549e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.457587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.490572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.491169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.491442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.492294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.492929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:06:15.493250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.494247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:15.494247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:06:15.494247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:06:15.495118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.505764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 757/1496] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:06:15.514679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89770a8d-a193-43b6-924c-047315976ffb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.524456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89770a8d-a193-43b6-924c-047315976ffb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.583979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:15.617792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.618384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.618657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.618926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.619554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.621289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:15.621289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:06:15.621289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:06:15.622476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.676419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 740/1497] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:06:15 2022] POST /identity/v3/projects => generated 377 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:15.680779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.682362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.716358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd49628-671b-4f82-bc43-7ce1eb744252 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:15.807969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:15.808566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:15.808842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:15.809112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:15.809786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:15.810794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:15.810794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:06:15.810794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:06:15.811989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:15.854595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 758/1498] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:06:15 2022] POST /identity/v3/users => generated 289 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:06:15.858974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:15.860494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:15.921063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617ca9ec-4238-435e-92e3-8ae32b46637b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.005829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.017846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.018443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.018714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.018982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.019609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.020630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:16.020630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:06:16.020630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:06:16.021531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.033746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 741/1499] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:06:15 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:06:16.037724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.039830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.050972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81d0e3e-ac5b-4e00-bdab-47ff3f48b77e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.075877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.145632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.146236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.146517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.146784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.147422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.148933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:16.148933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:06:16.148933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:06:16.149853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f401a7a-5b8f-4733-acbf-f58f510481c5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.161957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 759/1500] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:06:16.166831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.168315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.202032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8b32f9-2ea6-41cd-929f-8df51c4ce621 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.292979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.293688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.293838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.294102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] PATH_INFO: `/v3/projects/dab16fa0b8434d52b58d4627a05f7a5f/users/dcdbca201c2741d08c49a3ae392a1c51/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.315849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dab16fa0b8434d52b58d4627a05f7a5f, user_id=dcdbca201c2741d08c49a3ae392a1c51, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.316864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:16.316864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:06:16.316864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:06:16.318837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72991a04-ec97-4f60-b6fc-e2678abf5077 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.343069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 742/1501] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:06:16 2022] PUT /identity/v3/projects/dab16fa0b8434d52b58d4627a05f7a5f/users/dcdbca201c2741d08c49a3ae392a1c51/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:16.355929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437ff2-2e8e-436a-b7ac-f8fa757aa0a5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.356221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437ff2-2e8e-436a-b7ac-f8fa757aa0a5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.356714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a437ff2-2e8e-436a-b7ac-f8fa757aa0a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.415948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4a437ff2-2e8e-436a-b7ac-f8fa757aa0a5 None None] MFA Rules not processed for user `dcdbca201c2741d08c49a3ae392a1c51`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:16.417141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4a437ff2-2e8e-436a-b7ac-f8fa757aa0a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.494371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 760/1502] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:06:16.508012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.508439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.508725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.510108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 743/1503] 10.222.0.43 () {54 vars in 964 bytes} [Thu Sep 1 05:06:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:16.514973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c7e5-de52-4384-a3d2-2beccc88c67b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.515257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c7e5-de52-4384-a3d2-2beccc88c67b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.515533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1c7e5-de52-4384-a3d2-2beccc88c67b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.546093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.590157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-06b1c7e5-de52-4384-a3d2-2beccc88c67b None None] MFA Rules not processed for user `fec5602226564e6b95baf1ab9824ff0f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:16.591350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06b1c7e5-de52-4384-a3d2-2beccc88c67b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.664754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 761/1504] 10.222.0.43 () {58 vars in 1061 bytes} [Thu Sep 1 05:06:16 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:06:16.674567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:16.676068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.726762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.782735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6aa66c0-81ef-4529-bcb5-045af8b794f6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:16.855041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:16.855821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:16.856096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:16.856368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:16.857971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:16.953334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:16.954751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:16.958185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:16.973784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 744/1505] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:06:16 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:06:17.021222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d1e-6016-4c6f-976e-327c4d00dc92 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.021222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d1e-6016-4c6f-976e-327c4d00dc92 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.021222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d06d1e-6016-4c6f-976e-327c4d00dc92 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.022624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 762/1506] 10.222.0.43 () {52 vars in 830 bytes} [Thu Sep 1 05:06:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:06:17.026380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:17.029204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:17.127677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33798ec7-7600-4e2c-8fdd-f71f1167eaee service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.220410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.221013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.221316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.221585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] PATH_INFO: `/v3/users/dcdbca201c2741d08c49a3ae392a1c51` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.233843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=dcdbca201c2741d08c49a3ae392a1c51)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.234922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:17.234922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:06:17.234922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:06:17.236142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.246018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.303254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dcdbca201c2741d08c49a3ae392a1c51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:17.316931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dcdbca201c2741d08c49a3ae392a1c51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:17.340607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dcdbca201c2741d08c49a3ae392a1c51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:17.341177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dcdbca201c2741d08c49a3ae392a1c51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:17.349982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dcdbca201c2741d08c49a3ae392a1c51'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:17.356079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 745/1507] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:06:17 2022] DELETE /identity/v3/users/dcdbca201c2741d08c49a3ae392a1c51 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:17.360454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.360911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.361018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.419266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:06:17.420375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:17.493244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.504820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 763/1508] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:06:17.514984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:17.516250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:17.614660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f2f690-f2ec-454c-bef9-8ae4c53f7d4e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:17.671529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:17.694380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:17.695643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:17.695922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:17.696191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:17.697800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:17.807261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:17.808763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbce6f8a-380a-405c-9bf2-56474eea73e0 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:17.827911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 746/1509] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:06:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:06:18.156731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:06:18.157976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:06:18.169836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c0ba24-df0e-43f9-9816-bee92d2c838f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:06:18.264772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:06:18.265418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:06:18.265694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:06:18.265962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] PATH_INFO: `/v3/projects/dab16fa0b8434d52b58d4627a05f7a5f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:06:18.276483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] RBAC: Authorizing `identity:delete_project(project_id=dab16fa0b8434d52b58d4627a05f7a5f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:06:18.277501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:06:18.277501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:06:18.277501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:06:18.278690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:06:18.339784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dab16fa0b8434d52b58d4627a05f7a5f', 'request_id': 'req-196c6919-9f49-412e-b226-8d854d3cc75e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:18.349785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dab16fa0b8434d52b58d4627a05f7a5f', 'request_id': 'req-196c6919-9f49-412e-b226-8d854d3cc75e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:18.356223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dab16fa0b8434d52b58d4627a05f7a5f', 'request_id': 'req-196c6919-9f49-412e-b226-8d854d3cc75e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:18.386059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] The token cache is being invalidate because project dab16fa0b8434d52b58d4627a05f7a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:06:18.386694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:18.386807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-196c6919-9f49-412e-b226-8d854d3cc75e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:06:18.388155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 764/1510] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:06:18 2022] DELETE /identity/v3/projects/dab16fa0b8434d52b58d4627a05f7a5f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:06:27.825714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=62 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:06:28.383878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:54.039604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.040193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.040193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.041562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 747/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:54.046275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb22-cf52-4685-9aaa-d08b532e1e9e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.046677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb22-cf52-4685-9aaa-d08b532e1e9e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.046812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0bb22-cf52-4685-9aaa-d08b532e1e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.127241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45e0bb22-cf52-4685-9aaa-d08b532e1e9e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:54.128440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45e0bb22-cf52-4685-9aaa-d08b532e1e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:54.233873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 765/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:07:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:07:54.393300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:54.395375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:54.512357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb57eae-812f-4f5b-b54c-a8b1fe04ed00 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:54.517732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:54.518328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:54.518611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:54.518884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:54.527428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:54.528982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f982d578-97f0-45e2-9d53-3c9fc93518aa service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:54.538179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 748/1513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:07:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:07:55.377728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ff3f-e04a-4599-b726-75a8ef3254a2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.378214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ff3f-e04a-4599-b726-75a8ef3254a2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.378325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c759ff3f-e04a-4599-b726-75a8ef3254a2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.379628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 766/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:55.385275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1205-bedc-4a1c-a74a-3d21f7854f8a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.385728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1205-bedc-4a1c-a74a-3d21f7854f8a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.385839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faf1205-bedc-4a1c-a74a-3d21f7854f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.406286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7faf1205-bedc-4a1c-a74a-3d21f7854f8a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:55.407482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7faf1205-bedc-4a1c-a74a-3d21f7854f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:55.415338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 749/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:07:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:07:55.572234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ff3f-e04a-4599-b726-75a8ef3254a2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:55.587026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c759ff3f-e04a-4599-b726-75a8ef3254a2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:55.592346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:55.592974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:55.593294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:55.593571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:55.604452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:55.606015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4f7e43-9805-46db-b3c2-24bbde723660 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:55.615212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 767/1516] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:07:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:07:56.004046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a489-8a46-4f2a-a017-d2a11f913a0e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.004331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a489-8a46-4f2a-a017-d2a11f913a0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.004604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323a489-8a46-4f2a-a017-d2a11f913a0e None None] PATH_INFO: `/v3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.005931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 750/1517] 10.222.0.50 () {54 vars in 925 bytes} [Thu Sep 1 05:07:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:07:56.012098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8252-b3b7-4771-946c-0021ea1da7c4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:56.012386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8252-b3b7-4771-946c-0021ea1da7c4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:56.012664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd8252-b3b7-4771-946c-0021ea1da7c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:56.072865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-68fd8252-b3b7-4771-946c-0021ea1da7c4 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:56.074120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-68fd8252-b3b7-4771-946c-0021ea1da7c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:56.091445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:07:56.146335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 768/1518] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 1 05:07:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:07:59.875538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8cb8-9b74-4077-b693-b60b41c9f8f4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.876060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8cb8-9b74-4077-b693-b60b41c9f8f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.876060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612f8cb8-9b74-4077-b693-b60b41c9f8f4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.877417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 751/1519] 10.222.0.43 () {54 vars in 961 bytes} [Thu Sep 1 05:07:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:07:59.882738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db862d7-8ab1-449b-8100-d33de9d093a8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.883172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db862d7-8ab1-449b-8100-d33de9d093a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.883287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db862d7-8ab1-449b-8100-d33de9d093a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.903132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3db862d7-8ab1-449b-8100-d33de9d093a8 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:07:59.904325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3db862d7-8ab1-449b-8100-d33de9d093a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:07:59.912880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 769/1520] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Sep 1 05:07:59 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:07:59.920337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8cb8-9b74-4077-b693-b60b41c9f8f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:07:59.933972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612f8cb8-9b74-4077-b693-b60b41c9f8f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:07:59.938897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:07:59.939494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:07:59.939772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:07:59.940047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:07:59.949266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:07:59.950811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a1fa93-4080-48ed-bda3-c384d1c28caf service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:07:59.960611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 752/1521] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:07:59 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:08:06.857927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5108a5c-5682-4019-a05e-5068e633d853 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.858499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5108a5c-5682-4019-a05e-5068e633d853 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.858636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5108a5c-5682-4019-a05e-5068e633d853 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.859891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 770/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:08:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:06.864771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374bc0-3123-477e-ac75-53370e0c4116 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:06.865282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374bc0-3123-477e-ac75-53370e0c4116 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:06.865482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f374bc0-3123-477e-ac75-53370e0c4116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:06.885200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1f374bc0-3123-477e-ac75-53370e0c4116 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:06.886410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f374bc0-3123-477e-ac75-53370e0c4116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:06.894372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 753/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:08:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:07.050627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5108a5c-5682-4019-a05e-5068e633d853 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:07.065571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5108a5c-5682-4019-a05e-5068e633d853 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:07.071067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:07.071660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.071934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.072203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.080017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:07.081618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc08d02f-03ab-4217-91d9-7ae688dc6cf2 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:07.090951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 771/1524] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:07.926387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266c0a-f28a-459a-802c-b9c386b43ea1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.926920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266c0a-f28a-459a-802c-b9c386b43ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.926920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df266c0a-f28a-459a-802c-b9c386b43ea1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.928654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 754/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 1 05:08:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:07.933485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311389-3321-435a-b221-6259b228d32f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:07.933946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311389-3321-435a-b221-6259b228d32f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:07.934051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b311389-3321-435a-b221-6259b228d32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:07.955194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7b311389-3321-435a-b221-6259b228d32f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:07.956394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b311389-3321-435a-b221-6259b228d32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:07.964948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 772/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 1 05:08:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:08.117138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df266c0a-f28a-459a-802c-b9c386b43ea1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:08.131216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df266c0a-f28a-459a-802c-b9c386b43ea1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:08.136536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:08.137120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:08.137425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:08.137698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:08.145433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:08.147665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75a200-19b5-4801-8ff3-87d415a98fa6 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:08.156993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 755/1527] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:12.030147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.030727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.030727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.032021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 773/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:12.037270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fa5d-d0a1-4165-9a06-5851ba23f1a2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.037721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fa5d-d0a1-4165-9a06-5851ba23f1a2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.037830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d085fa5d-d0a1-4165-9a06-5851ba23f1a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.057327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d085fa5d-d0a1-4165-9a06-5851ba23f1a2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:12.058575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d085fa5d-d0a1-4165-9a06-5851ba23f1a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:12.066458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 756/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:08:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:12.359770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:12.361486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:12.438829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bdcc02-6974-4f3f-ae4f-bdacd0c8b3d8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:12.442425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:12.443630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:12.443922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:12.444186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:12.452908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:12.454368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822b20e-262c-4ba0-9167-38aaea30d846 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:12.463664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 774/1530] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:14.369511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3553-90d2-49f9-9227-48cca64695f1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.370068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3553-90d2-49f9-9227-48cca64695f1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.370068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2c3553-90d2-49f9-9227-48cca64695f1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.371424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 757/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:14.376707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd29e-0d2f-4c6b-8b2f-4dc9d36720a8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.377133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd29e-0d2f-4c6b-8b2f-4dc9d36720a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.377288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0cd29e-0d2f-4c6b-8b2f-4dc9d36720a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.396682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7e0cd29e-0d2f-4c6b-8b2f-4dc9d36720a8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:14.397911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7e0cd29e-0d2f-4c6b-8b2f-4dc9d36720a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:14.405744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 775/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:08:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:14.700791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3553-90d2-49f9-9227-48cca64695f1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:14.711972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2c3553-90d2-49f9-9227-48cca64695f1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:14.715455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:14.716041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:14.716316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:14.716584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:14.725717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:14.727380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ebe675-334b-4ed6-aff6-64dd08da1a67 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:14.736379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 758/1533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:18.117091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.117659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.117659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.118993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 776/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:18.124094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4da2-b62e-4eba-a32b-9594825f94d9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.124557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4da2-b62e-4eba-a32b-9594825f94d9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.124674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cd4da2-b62e-4eba-a32b-9594825f94d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.133047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:18.146622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-69cd4da2-b62e-4eba-a32b-9594825f94d9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:18.147936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-69cd4da2-b62e-4eba-a32b-9594825f94d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:18.155845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 759/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:08:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:18.711864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:18.713555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:18.777921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:18.791763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c479e24c-3769-4c9b-8fbe-7e10d4f8f252 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:18.795326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:18.795927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:18.796206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:18.796478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:18.805778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:18.807202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f77680-2fd2-4b67-b610-28429fb4a35a service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:18.816288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 777/1536] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:20.728319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.728844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.728844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.730316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 760/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 1 05:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:08:20.735594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd7ea-8b51-417a-aa9b-90b0760e5a85 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:20.735995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd7ea-8b51-417a-aa9b-90b0760e5a85 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:20.736146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a23cd7ea-8b51-417a-aa9b-90b0760e5a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:20.755869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a23cd7ea-8b51-417a-aa9b-90b0760e5a85 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:08:20.757093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a23cd7ea-8b51-417a-aa9b-90b0760e5a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:20.764740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 778/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 1 05:08:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:08:21.319274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:08:21.320942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:08:21.333748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef01d2b-105b-4186-a564-6538f107ee7d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:08:21.337456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:08:21.338096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:08:21.338341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:08:21.338616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:08:21.348392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:08:21.350495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da8a11-b0bf-4299-affc-480a0322892f service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:08:21.360052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 761/1539] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:08:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:08:30.750689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=11 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:08:31.355826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:47.270680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a66ef-5cd7-4272-86c2-48c19d649672 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.274354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a66ef-5cd7-4272-86c2-48c19d649672 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.274354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a66ef-5cd7-4272-86c2-48c19d649672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.298072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3b1a66ef-5cd7-4272-86c2-48c19d649672 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.299451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b1a66ef-5cd7-4272-86c2-48c19d649672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.312480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 779/1540] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.314053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfbfb2-e418-4266-9a2c-f153d7eddd93 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.315098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfbfb2-e418-4266-9a2c-f153d7eddd93 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.315192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cfbfb2-e418-4266-9a2c-f153d7eddd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.322824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.323164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.323380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.358396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-03cfbfb2-e418-4266-9a2c-f153d7eddd93 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.359694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03cfbfb2-e418-4266-9a2c-f153d7eddd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.363965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.365257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.383524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 780/1541] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.386997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 762/1542] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.388776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.396113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.396465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.396677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.400250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772960f2-0ed1-44f5-b484-6a2268b50978 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.412765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.413425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.413950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.414231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.415439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:47.415907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.417569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.438675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 781/1543] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:47.447701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.447896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.448923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.464114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60aaf7e7-764d-46ab-973e-5eed7d8a025a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.475178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 763/1544] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:09:47.477044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.477706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.477989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.478263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.478905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.479644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.480098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:47.480098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:09:47.480098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:09:47.481339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.499753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3174ae87-ee85-420e-9b81-7bea51dd9ae0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.522273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.522943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.523281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.523536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.524272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:47.524585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.525742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:47.525742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:09:47.525742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:09:47.526677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a40f8a-f44e-4a44-af25-bd75c509dc6a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.549466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 764/1545] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:09:47.549749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 782/1546] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/projects => generated 373 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:47.552417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762daed-a3c4-4dd1-a316-14d7175212d7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.552780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762daed-a3c4-4dd1-a316-14d7175212d7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.553109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2762daed-a3c4-4dd1-a316-14d7175212d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.553707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.586033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2762daed-a3c4-4dd1-a316-14d7175212d7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.587252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2762daed-a3c4-4dd1-a316-14d7175212d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.675917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278063eb-3a6e-484b-ab53-706bd193c305 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.681411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.682311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.682827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.683465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.684469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.686663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.697567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 765/1547] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.699091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfa7-2715-4abf-98e9-590ab226d924 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.699383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfa7-2715-4abf-98e9-590ab226d924 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.699733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d86dfa7-2715-4abf-98e9-590ab226d924 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.711439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 783/1548] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/users => generated 287 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:47.712502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.722895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5863a96-a58e-4968-ace7-e290c44607fd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.723075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9d86dfa7-2715-4abf-98e9-590ab226d924 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.725354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d86dfa7-2715-4abf-98e9-590ab226d924 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.731918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.732593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.732881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.733163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.733734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 766/1549] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.733845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.735067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aebf6-88c9-484a-abbe-b16d42e6a4bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.735349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aebf6-88c9-484a-abbe-b16d42e6a4bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.735619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9aebf6-88c9-484a-abbe-b16d42e6a4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.735930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c011bcc-5afb-4f5c-8eee-1a610d8f0ea1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.755922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5e9aebf6-88c9-484a-abbe-b16d42e6a4bd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.757376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5e9aebf6-88c9-484a-abbe-b16d42e6a4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.766338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 767/1550] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.767662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.771253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 784/1551] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/projects => generated 405 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:47.771438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.771438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.771677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e20d0-e960-4edc-a31d-f041077f3408 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.771677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e20d0-e960-4edc-a31d-f041077f3408 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.771677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3e20d0-e960-4edc-a31d-f041077f3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.791327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.791941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-da3e20d0-e960-4edc-a31d-f041077f3408 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.792465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.793106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da3e20d0-e960-4edc-a31d-f041077f3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.852330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 785/1552] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.853439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 768/1553] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.853629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd0f0-49e0-4ef2-bcea-b68fe593d48e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.853907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd0f0-49e0-4ef2-bcea-b68fe593d48e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.854283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504dd0f0-49e0-4ef2-bcea-b68fe593d48e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.858116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.868891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d54e79-82d0-444e-8cc4-c74c5466dcbf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.873536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.874132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.874407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.874678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.875313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.877577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f425e7-d14f-482d-a996-1cfc71e99079 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.878250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-504dd0f0-49e0-4ef2-bcea-b68fe593d48e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.879433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-504dd0f0-49e0-4ef2-bcea-b68fe593d48e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.890358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 786/1554] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.890517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 769/1555] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:47.890630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.890630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.890822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fea4-c976-4af8-9fd6-0c0574971cad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.890911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.890989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fea4-c976-4af8-9fd6-0c0574971cad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.890989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5fea4-c976-4af8-9fd6-0c0574971cad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.897504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:47.909821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9bd5fea4-c976-4af8-9fd6-0c0574971cad None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.909988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.911027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9bd5fea4-c976-4af8-9fd6-0c0574971cad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.911137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.918952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 787/1556] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.919108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 770/1557] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.919777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.920252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2db7-6bc9-4ea5-b21d-42373289d514 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.920535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2db7-6bc9-4ea5-b21d-42373289d514 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.920806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212b2db7-6bc9-4ea5-b21d-42373289d514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.933434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe8407c-a217-4e11-88ba-c98ecb7931aa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:47.938357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:47.938962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.940061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.940501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.941162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:47.943121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b79b3b7-f7e3-461f-9531-63d538286c47 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:47.944367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-212b2db7-6bc9-4ea5-b21d-42373289d514 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.945664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-212b2db7-6bc9-4ea5-b21d-42373289d514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.953770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 771/1558] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.955558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.955916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.956193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.974466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 788/1559] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/users => generated 303 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:47.975955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:47.976247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:47.976526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:47.981871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.983074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:47.991162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 772/1560] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:47.991957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:47.996318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:47.997552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:48.001391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c65be7-a061-4892-ba52-0358b08a8a0b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.006109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 789/1561] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:48.006486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.006950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.007071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.007350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.007629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.008275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.008639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.010203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.016938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55098ee5-4194-40a2-9da6-26eb37b9f341 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.022263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.029360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 773/1562] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.029520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.029520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.029520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.029771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.029885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.029885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99064fbd-7749-448a-9f78-ab3c604e1b34 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.035900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 790/1563] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.037147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.037456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.037732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.041697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf139fd1-8009-4eff-86f0-1aa95df7c651 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.047185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.047906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.048194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.048473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.049450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.049769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.051368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.056523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:48.057726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:48.071235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 774/1564] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.071235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.071535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 791/1565] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:48.071535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.075184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.076513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f46f2d5-f51f-4324-9384-b0e7148287c6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.079234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb78a7f-84a8-49e9-8fe5-2d0764f86893 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.082085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.082745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.083022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.083292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.083926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.085447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.085587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.086056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.086338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.086617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.087262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.087565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.089140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.098760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 792/1566] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.098760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.101823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 775/1567] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.102532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.106464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26298e67-54e7-4c5b-b7a1-7e3cfcbb0776 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.111164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.111753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.112034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.112298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.112930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.113256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.114087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861dcb83-52e9-4108-890e-ed718721819d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.114861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.118733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.119329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.119608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.119883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.120522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.120825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.122426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.126706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 793/1568] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.128360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.145227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 776/1569] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.145425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9020fbed-f38c-4bc7-a121-c63bc4fab473 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.145581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.145695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.145695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.145695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.145695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.146075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.147291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.148648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a0bae9-f938-490b-a09e-f60b50baa0f5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.153209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.153866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.154178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.154454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] PATH_INFO: `/v3/projects/dc1d409d5d9f45e98fc0896aee9b4264/users/6cba1151b2504cd8bae0eb21d376bb60/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.169627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc1d409d5d9f45e98fc0896aee9b4264, user_id=6cba1151b2504cd8bae0eb21d376bb60, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.172292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.177247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 794/1570] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 371 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.178310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.186611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 777/1571] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:48 2022] PUT /identity/v3/projects/dc1d409d5d9f45e98fc0896aee9b4264/users/6cba1151b2504cd8bae0eb21d376bb60/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:48.187443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.245851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c604fae1-9c3c-484a-90be-236b57879d2f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.250758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.251087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196198f-977b-4d6e-8f29-35c950c2969f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.251365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.251650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.252595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.253535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:48.253847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.255458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.256262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.256859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.257132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.257428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.258048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.259914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.267248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 795/1572] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:48.268858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.279723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da1a24c-1068-4bff-b150-d64d66e8da29 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.284772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.285515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.285891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.286265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.286999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.288079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 778/1573] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 391 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.288916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.291976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.305565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 796/1574] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.309820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.320395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de739fdf-0c60-47dc-aed8-79454b29cf77 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.353738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6fd00c-216a-4192-b15b-76eb5547247c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.358462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.359074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.359359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.359636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.360267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.363158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.369388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.380375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.381054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.381458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.381767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.382495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.384693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.392048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 779/1575] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.393628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.413410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 797/1576] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 389 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.414355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.424615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.460985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f312969-29a2-4961-ae4d-f9d91a9c5383 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.475337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c8c803-30a9-44cc-89bd-9244f98b2f57 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.480142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.480738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.481017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.481328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.481977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.483885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63053f82-7a56-42ec-be9f-c10c7d720434 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.505515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 798/1577] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.506991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.507273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.507547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.520742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.521457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.521740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.522007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.522626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.524504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.536973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] MFA Rules not processed for user `6cba1151b2504cd8bae0eb21d376bb60`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:48.538212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:48.556306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 780/1578] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 379 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.556306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.603934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 799/1579] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:48.604754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.622742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8145839-2b60-4ad8-a5c7-13b50ee707e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.625884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb11b22-f8d6-4717-b09f-6ae2c20a5a9d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.629369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.630030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.630411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.630785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.631577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.632195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.632789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.633076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.633500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.634043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.634461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.636627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.655186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 800/1580] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 296 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.656129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.666084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bcc3164-0ba6-46ca-864a-79d1bb645e9c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.668378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 781/1581] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/projects => generated 375 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.669052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.709664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.713777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:48.730408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.731067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.731345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.731618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] PATH_INFO: `/v3/projects/5c900426e4de40468379ce2a5d0f736b/users/821d9beabafc4a988cdf7b6d71214ffc/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.733890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148f84be-2a42-45f9-8cc6-8b989e214d87 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.739165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.739772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.740051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.740324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.740947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.742000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:48.742000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:09:48.742000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:09:48.743205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.747550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c900426e4de40468379ce2a5d0f736b, user_id=821d9beabafc4a988cdf7b6d71214ffc, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.748564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:48.748564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:09:48.748564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:09:48.750523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.764087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 801/1582] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:48 2022] PUT /identity/v3/projects/5c900426e4de40468379ce2a5d0f736b/users/821d9beabafc4a988cdf7b6d71214ffc/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:48.767765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 782/1583] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.767872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.767978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.777271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae22c7f-b04a-41f8-a91d-8f7734d93557 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.830434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e12500-e9ec-4c5c-8c6d-53b1b69e7901 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.833425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.834022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.834305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.834582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.834977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.835252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.835574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.835853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.836123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.836745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.836853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.838705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f559001-5767-4711-9716-1d62576d4ebf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.847436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 783/1584] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.848012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.859188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512a561-9a7a-4414-ba4c-06eb3df69929 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.860997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 802/1585] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.862507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f133a7-0c30-4f56-9964-2708d7fee7bf None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.862798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f133a7-0c30-4f56-9964-2708d7fee7bf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.863072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f133a7-0c30-4f56-9964-2708d7fee7bf None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.864270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 803/1586] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 05:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:48.864969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f133a7-0c30-4f56-9964-2708d7fee7bf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.867735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.868887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.869391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.869872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.870537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.873350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.877671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f133a7-0c30-4f56-9964-2708d7fee7bf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.882206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.882777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.883060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.883337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.883974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.885588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.896130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 804/1587] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.899529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 784/1588] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 290 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.899643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.899756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.907146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9d62e9-1317-42c3-b71b-81d5b904ac13 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.909550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc372299-c1ed-42eb-ac0e-337a70cc7593 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.912311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.912906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.913205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.913483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.914111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.914361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.914957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.915235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.915510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.915684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ea61fe-195b-4871-af9a-a1f23d925124 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.916132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.918138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.926234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 785/1589] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.927713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.927713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.927940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.942100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 805/1590] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/users => generated 288 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:48.942928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.951324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:48.952520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:48.952790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e07622-e78a-4864-b808-7d2c0d50bbc1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.958179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.958808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.959086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.959353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.959988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.960910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 786/1591] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:48.961713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:48.964854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d9feb9-c430-4536-96e2-4f2be3aa0753 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.971673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117cbc7f-b2ae-4c80-9689-6cef41eb7fa6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:48.975937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 806/1592] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.977155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.977482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.977758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.979732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:48.980361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:48.980640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:48.980908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:48.981571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:48.983145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:48.996614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 787/1593] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:48.996614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.004720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f5916c-559f-4ebc-8455-f33c2b7e579c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.009217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.009799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.010074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.010345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.010961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.012867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.018371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:49.019666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:49.023635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 788/1594] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.024504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.034056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b20df-1245-4fca-9d33-32650a9a9fdf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.038602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.039175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.039449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.039723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.040454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.042051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.052036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 789/1595] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.052811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.062141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771f05b8-9de4-4fc8-94ea-3471eb9c2053 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.067668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.068315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.068674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.069009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.069729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.071314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.072860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.085843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 790/1596] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.085843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.092650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ffe92-f26e-4640-b9d7-c144187aaf0e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.094659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 807/1597] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 05:09:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:49.095716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.097724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.098767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.099234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.099666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.100440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.102210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.112974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 791/1598] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.113971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.123392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66aea38-0193-457a-a4d9-c8d861eb25b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.128944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.129603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.129882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.130152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] PATH_INFO: `/v3/projects/241dda43ecc34880866e04d9a6fa084e/users/5319cbe093a2477287abe74c858192fb/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.146476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] RBAC: Authorizing `identity:create_grant(project_id=241dda43ecc34880866e04d9a6fa084e, user_id=5319cbe093a2477287abe74c858192fb, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.149122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.153770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8951bbb2-1cec-49ec-8821-e01549867b17 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.158301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.158906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.159179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.159447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.162808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 792/1599] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/241dda43ecc34880866e04d9a6fa084e/users/5319cbe093a2477287abe74c858192fb/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.163597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.172162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.174319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.177166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.185438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 808/1600] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:49.186480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.196520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0713ef-5c1e-47d4-8d6a-72d72e6f13be service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.233595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa3a750-7799-4eb4-8dab-ae70111b8828 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.241062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.241761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.242043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.242686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.243343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.245864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.261806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 793/1601] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.261806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.264166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.265234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.265579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.265918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] PATH_INFO: `/v3/projects/712a1f97325f4f0299e99ac544a8f3aa/users/5ed5cf12b4354c7d88fe6e69f15cf335/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.272385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304e0913-1533-462f-ba33-d1925c56d962 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.277842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.278544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.278945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.279316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.280064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.281844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.285341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=712a1f97325f4f0299e99ac544a8f3aa, user_id=5ed5cf12b4354c7d88fe6e69f15cf335, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.288630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.296733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 794/1602] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.296733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.305900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 809/1603] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/712a1f97325f4f0299e99ac544a8f3aa/users/5ed5cf12b4354c7d88fe6e69f15cf335/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.306715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.310008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a412dd0-358e-409e-b20f-802b3891918f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.380179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.380817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.381410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.381827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] PATH_INFO: `/v3/projects/97027b0fa5a6437f8f305c2a93d723d2/users/2a0b1d047f5945c3991f9727fded215b/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.389750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a31b2d-1b16-46f1-87f5-77c681da2c2f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.395914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.396673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.396955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.397513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.401349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] RBAC: Authorizing `identity:create_grant(project_id=97027b0fa5a6437f8f305c2a93d723d2, user_id=2a0b1d047f5945c3991f9727fded215b, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.404153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.412138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.423315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 795/1604] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/97027b0fa5a6437f8f305c2a93d723d2/users/2a0b1d047f5945c3991f9727fded215b/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.424319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.471618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.474469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a46bef-d332-4088-aef4-ca54db53391a service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.493772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 810/1605] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:49.495191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414197-d6b4-4d88-9ff4-4e89d38548ee None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.495324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac5f4d8-f843-4fbe-b147-a1bd4287739b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.495485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414197-d6b4-4d88-9ff4-4e89d38548ee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.495763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df414197-d6b4-4d88-9ff4-4e89d38548ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.500891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.502363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.503192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.503650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.504447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.506349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.520545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 796/1606] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:49.521601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.532132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcee0d-a26d-4378-ae71-9b804b3d89b4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.534663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-df414197-d6b4-4d88-9ff4-4e89d38548ee None None] MFA Rules not processed for user `5319cbe093a2477287abe74c858192fb`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:49.536662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-df414197-d6b4-4d88-9ff4-4e89d38548ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:49.551350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.552586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.553045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.553497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] PATH_INFO: `/v3/projects/73688aab1b864a179b05b83ae930d59d/users/386e1605489846248e898a62c79643fe/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.577373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73688aab1b864a179b05b83ae930d59d, user_id=386e1605489846248e898a62c79643fe, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.582624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.587140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.612236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 797/1607] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/73688aab1b864a179b05b83ae930d59d/users/386e1605489846248e898a62c79643fe/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.612236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.616999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 811/1608] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:49.618506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fd0e-a514-4c1c-b602-6abd4b8b616f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.618803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fd0e-a514-4c1c-b602-6abd4b8b616f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.619078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8fd0e-a514-4c1c-b602-6abd4b8b616f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.647487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9ef8fd0e-a514-4c1c-b602-6abd4b8b616f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:49.648698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ef8fd0e-a514-4c1c-b602-6abd4b8b616f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:49.702294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13368db8-5efc-4f57-bc3c-b1a5fa572069 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.709789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.711272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.711756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.712210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] PATH_INFO: `/v3/projects/524a60b89cb04ec2bef9d0208d390e85/users/21b1739c7e9945639af536a9652a49e7/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.729438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 812/1609] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:49.731091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe7ad-261e-4190-92be-f363404cefab None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.731478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe7ad-261e-4190-92be-f363404cefab None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.731942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fbbe7ad-261e-4190-92be-f363404cefab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.732194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=524a60b89cb04ec2bef9d0208d390e85, user_id=21b1739c7e9945639af536a9652a49e7, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.735662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.757127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 798/1610] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/524a60b89cb04ec2bef9d0208d390e85/users/21b1739c7e9945639af536a9652a49e7/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.758493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.768840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8fbbe7ad-261e-4190-92be-f363404cefab None None] MFA Rules not processed for user `2a0b1d047f5945c3991f9727fded215b`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:49.770518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8fbbe7ad-261e-4190-92be-f363404cefab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:49.813442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:49.873257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384d1d55-8659-4159-bbd6-31ede14cfff6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:49.873257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:49.879956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.879956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.879956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] PATH_INFO: `/v3/projects/4234819ec6fc47859f0b4b22f5cdb344/users/6efb292e19dc445b9b01e455fa2befec/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.881644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 813/1611] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:49 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:49.881644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326877e1-a2d5-4cdf-8514-b36e54f1a48b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.881644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326877e1-a2d5-4cdf-8514-b36e54f1a48b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.881644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326877e1-a2d5-4cdf-8514-b36e54f1a48b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.900104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4234819ec6fc47859f0b4b22f5cdb344, user_id=6efb292e19dc445b9b01e455fa2befec, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:49.902578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dafc4a4-d51c-424e-9379-5a0fea263ac4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:49.913862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-326877e1-a2d5-4cdf-8514-b36e54f1a48b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:49.915255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-326877e1-a2d5-4cdf-8514-b36e54f1a48b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:49.922846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 799/1612] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:49 2022] PUT /identity/v3/projects/4234819ec6fc47859f0b4b22f5cdb344/users/6efb292e19dc445b9b01e455fa2befec/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:49.922846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ce9-2cd9-4c0d-a52e-444b92b231a4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.922846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ce9-2cd9-4c0d-a52e-444b92b231a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:49.922846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e33ce9-2cd9-4c0d-a52e-444b92b231a4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:49.929365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 800/1613] 10.222.0.43 () {54 vars in 962 bytes} [Thu Sep 1 05:09:49 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:49.931249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33ce9-2cd9-4c0d-a52e-444b92b231a4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:49.997973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 814/1614] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:49.999372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9fe0d-8f4c-4300-ae57-d1bad4850734 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:49.999795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9fe0d-8f4c-4300-ae57-d1bad4850734 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.000078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9fe0d-8f4c-4300-ae57-d1bad4850734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.021521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e33ce9-2cd9-4c0d-a52e-444b92b231a4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.021791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45d9fe0d-8f4c-4300-ae57-d1bad4850734 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.022888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45d9fe0d-8f4c-4300-ae57-d1bad4850734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.025719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.026533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.026660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.026865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.033924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 815/1615] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:50.039586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19cdb-86e6-4e5c-8b76-dbad8208f31e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.040099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19cdb-86e6-4e5c-8b76-dbad8208f31e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.040853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e19cdb-86e6-4e5c-8b76-dbad8208f31e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.041596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.042793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 816/1616] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 05:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:50.043690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6dbccec-cc44-4548-a47f-faf17575081c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.044500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6271-0fa5-4f22-961c-a7f9fa7783d8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.044977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6271-0fa5-4f22-961c-a7f9fa7783d8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.045473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bb6271-0fa5-4f22-961c-a7f9fa7783d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.055744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 801/1617] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.057169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.057485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.057768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.066357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:50.069483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-06bb6271-0fa5-4f22-961c-a7f9fa7783d8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.070994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06bb6271-0fa5-4f22-961c-a7f9fa7783d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.081272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.082354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 817/1618] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:50.082814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.083899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.084282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.084653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.121539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] MFA Rules not processed for user `821d9beabafc4a988cdf7b6d71214ffc`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.122863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.209497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 802/1619] 10.222.0.43 () {58 vars in 1059 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:50.210534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.212375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.221909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 818/1620] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:50.221909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.225986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f98811a-9295-411c-bc07-32f9ebfe0efa None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.230403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.230947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27271d53-fafa-438f-a7e8-88cd70a20baa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.231160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.231505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.231845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.235070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.235821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.236196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.236479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.242051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.243555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-accf6208-4443-4247-92cf-a232906a5f2f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.247053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.248481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.254570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 803/1621] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.255810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.256270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.256610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.276603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 819/1622] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.277699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.278895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.279196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.293309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 804/1623] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:50.294699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.301529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e8410-4de2-44e7-9a1a-3a012d86f44b service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.307652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.308698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.309434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.309712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.321596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d921da90-a81b-4fed-b6e3-3a3901e77ce0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.330770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.331485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.331949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.332336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.338036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.339497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.354607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 820/1624] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.355498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.367648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a8f821-1644-4f4b-ad5d-f3dfa6cc2a8e service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.382180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.383229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.383743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.384718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.387197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.390617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.444655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.446512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.447003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 821/1625] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/projects => generated 405 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:50.448384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.464926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 805/1626] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.466218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.466817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:50.482753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e1a02-74c5-4702-9fad-02e86ee1179c service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.570427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf35c48-411a-4100-ab43-8011f2204ddd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.571233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.571818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.572367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.572367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.573489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.575415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.584397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.585895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.587024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.587973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.611775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 806/1627] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/users => generated 309 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:50.613304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.621751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:50.632687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647af126-0327-4abe-a431-c3558b0aff5d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.647771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.648669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.649027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.649402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.650314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.652301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.676681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 807/1628] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:50.683344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.708404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e179f2e-fd43-4003-9ea7-58c02fd7615a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.718420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.719245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.719722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.721108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] PATH_INFO: `/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1/users/588d3307175140a6bb0822bbe3db7ab0/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.726748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.730646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.746271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 822/1629] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:50.757474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b7fbf3209d46f39e25a86bcfdc04b1, user_id=588d3307175140a6bb0822bbe3db7ab0, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.760228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d052f6c-5305-40e6-b067-a04c8d3159e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.791784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 808/1630] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:50 2022] PUT /identity/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1/users/588d3307175140a6bb0822bbe3db7ab0/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:50.796423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:50.813550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077183ff-6038-4653-871e-a260630e61f9 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:50.838753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb90e7-f694-4050-8959-4df53c65c697 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.838753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb90e7-f694-4050-8959-4df53c65c697 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.839093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfb90e7-f694-4050-8959-4df53c65c697 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.840440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 809/1631] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 05:09:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:09:50.850827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.851118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.851400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.892864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:50.894676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:50.949435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:50.953108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:50.953432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:50.953713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:50.954387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:50.956572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:50.978317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 823/1632] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:50.979590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:51.051296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 810/1633] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:09:50 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:09:51.052768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:51.059143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:51.092382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db4071a6-bc72-4886-b9dc-6fc6dcaf1462 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:51.103036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:51.103801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:51.104006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:51.104281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] PATH_INFO: `/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1/users/588d3307175140a6bb0822bbe3db7ab0/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:51.106305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c0b7fbf3209d46f39e25a86bcfdc04b1, user_id=588d3307175140a6bb0822bbe3db7ab0, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:51.109051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:51.114187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e66d694-9776-4424-8edf-3a70ae9c7b05 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:51.121335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:51.122745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:51.123353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:51.123838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:51.135628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 811/1634] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:51 2022] PUT /identity/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1/users/588d3307175140a6bb0822bbe3db7ab0/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:51.136793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:51.226867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:51.230224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:51.258640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7890afc9-f939-41de-9f27-6c7193874be0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:51.259846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 824/1635] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:51.264480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:51.265227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:51.265521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:51.265802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:51.410402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:51.451757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:51.453527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef1dbcb-edbb-40e3-9fb9-db9b99ab731a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:51.466867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 812/1636] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:52.371399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:52.398147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4be3502-65b6-43c6-92ef-71ade56bf3a4 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:52.565627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:52.566493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:52.566980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:52.567589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] PATH_INFO: `/v3/users/6cba1151b2504cd8bae0eb21d376bb60` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:52.569801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cba1151b2504cd8bae0eb21d376bb60)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:52.571654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:52.571654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Sep 01 05:09:52.571654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: Sep 01 05:09:52.573018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:52.696295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cba1151b2504cd8bae0eb21d376bb60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:52.712950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cba1151b2504cd8bae0eb21d376bb60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:52.722694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cba1151b2504cd8bae0eb21d376bb60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:52.723655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cba1151b2504cd8bae0eb21d376bb60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:52.749004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cba1151b2504cd8bae0eb21d376bb60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:52.752227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:52.765971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 825/1637] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:09:52 2022] DELETE /identity/v3/users/6cba1151b2504cd8bae0eb21d376bb60 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:52.770162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91afc-210a-4c58-9bd3-4077e7904593 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:52.770741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91afc-210a-4c58-9bd3-4077e7904593 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:52.770741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b91afc-210a-4c58-9bd3-4077e7904593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:52.795420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c2b91afc-210a-4c58-9bd3-4077e7904593 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:52.796706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2b91afc-210a-4c58-9bd3-4077e7904593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:52.906706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 813/1638] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:52.939615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:52.942524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:53.113167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac795a54-8c6d-4466-96d8-58d6b548a874 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:53.130056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:53.130838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:53.131129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:53.131413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:53.162506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:53.163708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:53.187252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 826/1639] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:53.853094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf874e-9e96-494f-b59e-cd44e2589e91 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:53.853650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf874e-9e96-494f-b59e-cd44e2589e91 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:53.853650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cabf874e-9e96-494f-b59e-cd44e2589e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:53.940970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cabf874e-9e96-494f-b59e-cd44e2589e91 None None] MFA Rules not processed for user `588d3307175140a6bb0822bbe3db7ab0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:53.942251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cabf874e-9e96-494f-b59e-cd44e2589e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:54.172519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 814/1640] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:53 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 320 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:55.617731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:55.620767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:55.642774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba0c44d-5863-4e41-b0fc-7a3738c0761d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:55.656868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:55.657577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:55.658446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:55.658732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] PATH_INFO: `/v3/users/5319cbe093a2477287abe74c858192fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:55.662123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5319cbe093a2477287abe74c858192fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:55.663954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:55.813694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5319cbe093a2477287abe74c858192fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:55.833449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5319cbe093a2477287abe74c858192fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:55.858861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5319cbe093a2477287abe74c858192fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:55.859721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5319cbe093a2477287abe74c858192fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:55.886899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5319cbe093a2477287abe74c858192fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:55.899932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 827/1641] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:09:55 2022] DELETE /identity/v3/users/5319cbe093a2477287abe74c858192fb => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:55.904232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:55.905066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:55.905507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:55.945863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:55.947454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:56.099841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 815/1642] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:56.167325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:56.169535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:56.299184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5325d9-72c8-49b5-ac06-9e6e06780ef6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:56.303515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:56.304154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:56.305026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:56.305026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:56.318152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:56.319591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc9582c-7c62-4928-9c61-617a8e93be0a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:56.339648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 828/1643] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:56.528453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:56.530176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:56.561266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25bfe26-0fc1-4957-839b-4a793768cdf5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:56.568130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:56.568998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:56.569437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:56.570115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] PATH_INFO: `/v3/projects/dc1d409d5d9f45e98fc0896aee9b4264` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:56.571480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc1d409d5d9f45e98fc0896aee9b4264)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:56.572621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 01 05:09:56.572621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Sep 01 05:09:56.572621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: Sep 01 05:09:56.574247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:56.592177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:56.763987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc1d409d5d9f45e98fc0896aee9b4264', 'request_id': 'req-d1c07239-de60-43bb-b9e2-b71a3bfe4262'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:56.778336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99530-80a2-4718-8dcb-cc8ce25dbd3e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:56.778875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99530-80a2-4718-8dcb-cc8ce25dbd3e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:56.778875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c99530-80a2-4718-8dcb-cc8ce25dbd3e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:56.781465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 829/1644] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:09:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:09:56.801129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc1d409d5d9f45e98fc0896aee9b4264', 'request_id': 'req-d1c07239-de60-43bb-b9e2-b71a3bfe4262'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:56.820575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc1d409d5d9f45e98fc0896aee9b4264', 'request_id': 'req-d1c07239-de60-43bb-b9e2-b71a3bfe4262'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:56.858417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:56.858704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:56.859056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:56.867408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] The token cache is being invalidate because project dc1d409d5d9f45e98fc0896aee9b4264 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:09:56.868695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:56.872411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d1c07239-de60-43bb-b9e2-b71a3bfe4262 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:56.874867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 816/1645] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:09:56 2022] DELETE /identity/v3/projects/dc1d409d5d9f45e98fc0896aee9b4264 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:56.881600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae35-207c-4eec-be00-4708900852fa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:56.882653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae35-207c-4eec-be00-4708900852fa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:56.883034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b0ae35-207c-4eec-be00-4708900852fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:56.932486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:56.933904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:56.955734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-80b0ae35-207c-4eec-be00-4708900852fa None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:56.956283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:56.956998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80b0ae35-207c-4eec-be00-4708900852fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.114022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 830/1646] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:09:57.115098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.116617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.128668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 817/1647] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:57.135949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.136230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.136505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.153785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4c09e3-c3f3-47bf-b9ca-7ad20ca4e540 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.170449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:57.173973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.175271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.176128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.176584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.178486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] PATH_INFO: `/v3/users/2a0b1d047f5945c3991f9727fded215b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.184859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0b1d047f5945c3991f9727fded215b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.187191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.197904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 818/1648] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:09:57.197904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.200010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.243197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4e4bfd-bf60-48a8-9e90-a56a3ee1ba17 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.253681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.255882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.256168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.257659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.278396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.281900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.295021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0b1d047f5945c3991f9727fded215b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:57.311178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 819/1649] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:57.312585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.314653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0b1d047f5945c3991f9727fded215b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:57.334278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0b1d047f5945c3991f9727fded215b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:57.335040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0b1d047f5945c3991f9727fded215b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:57.341431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7755e0-36d3-4b3c-a56f-6dfbea56191f service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.354162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.355528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.357490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a67e0ebf-4da3-42f5-a7de-585615a13937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0b1d047f5945c3991f9727fded215b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:57.358066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.358519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.359478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:57.362141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.363986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.375695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 831/1650] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:09:57 2022] DELETE /identity/v3/users/2a0b1d047f5945c3991f9727fded215b => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:57.380699 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.381263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.381454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.392915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 820/1651] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:57.397649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.400314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.426674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca61e1cc-b9b7-48da-aa40-9d9b2f369ce3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.441930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:57.443180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.566565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.567196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.567473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.567742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.568376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.570318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.597720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:57.623312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 832/1652] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:09:57.637568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 821/1653] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:57 2022] POST /identity/v3/projects => generated 373 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:57.641426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.665466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.668777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:57.676093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb812aba-0233-488a-ac84-2fa9cb880bd0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.743918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:57.831673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.833797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.834325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.835307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.836993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.838964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.854774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a20f4-6082-4bcd-9099-1cc4aa34f03e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.862394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.863194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.863476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.863888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.893906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 833/1654] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:57 2022] POST /identity/v3/users => generated 287 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:57.895830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.897901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.902549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.926362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1caa2fd8-7873-44e7-be10-752395f69164 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:57.935028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 822/1655] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:09:57.950452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:57.951147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:57.951425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:57.951913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:57.952633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:57.954343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:57.967825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 834/1656] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:09:57.972078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:57.992433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a28083d-0405-4192-9db8-6f9a2aecd71f service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.002648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.003953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.004545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.005032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.006423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.008900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4f00b8-8c71-4bb0-8224-6545df2b3412 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.029790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 823/1657] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:57 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:58.033693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.045593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1924e57-1aac-4338-81d5-8d1d8218f0cc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.052233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.053121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.053524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.053920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] PATH_INFO: `/v3/projects/6e655d2d79ba47aeb65c06a8b8ec9f8a/users/e99e34a50574453d810708974510bd71/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.073064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e655d2d79ba47aeb65c06a8b8ec9f8a, user_id=e99e34a50574453d810708974510bd71, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.076054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.101871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 835/1658] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:58 2022] PUT /identity/v3/projects/6e655d2d79ba47aeb65c06a8b8ec9f8a/users/e99e34a50574453d810708974510bd71/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:58.115155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.115511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.115828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.196367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] MFA Rules not processed for user `e99e34a50574453d810708974510bd71`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:58.197681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:58.375758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 824/1659] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:58.379100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.586906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb708956-b420-40a1-9938-9f9c695ffef2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:58.607382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:58.608356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:58.609516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:58.610242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:58.611553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:58.614275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:58.680338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.682580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:58.735564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 836/1660] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:58 2022] POST /identity/v3/projects => generated 373 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:58.740308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:58.742518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3493d46-99ef-4690-96cb-49c649aa9f5c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.007991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44808d9-5438-4958-a13e-351627e8eebb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.008431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.013925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.014425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.014894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] PATH_INFO: `/v3/projects/241dda43ecc34880866e04d9a6fa084e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.016415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=241dda43ecc34880866e04d9a6fa084e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.020114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.027780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.028661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.028884 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.029372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.030337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.033300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.063399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:59.075523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:59.096980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 837/1661] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:58 2022] POST /identity/v3/users => generated 293 bytes in 354 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:09:59.099094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.138225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9838bd23-cf3b-436f-bb6d-9601655d27a7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.166257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '241dda43ecc34880866e04d9a6fa084e', 'request_id': 'req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:59.179146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '241dda43ecc34880866e04d9a6fa084e', 'request_id': 'req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:59.192953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '241dda43ecc34880866e04d9a6fa084e', 'request_id': 'req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:59.219615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] The token cache is being invalidate because project 241dda43ecc34880866e04d9a6fa084e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:09:59.220349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:59.221788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f634bb5f-2559-46e1-a3eb-c186b9ce86f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:09:59.223891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 825/1662] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:09:58 2022] DELETE /identity/v3/projects/241dda43ecc34880866e04d9a6fa084e => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:59.230978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45887d10-9116-4923-97ba-0411fb1c39d5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.231324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45887d10-9116-4923-97ba-0411fb1c39d5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.231531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45887d10-9116-4923-97ba-0411fb1c39d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.275210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-45887d10-9116-4923-97ba-0411fb1c39d5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:59.281317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45887d10-9116-4923-97ba-0411fb1c39d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:59.299280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.300745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.301039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.301352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.302033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.304881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.333637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 838/1663] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:59.334817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.340057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:59.370034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97269393-d31b-492e-972a-71411ffed848 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.384237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.384930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.385276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.385559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] PATH_INFO: `/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98/users/4617fec60b8f4721ad9476f0b38af79b/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.415386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7b18f85d70428b9d9f8e64722b5e98, user_id=4617fec60b8f4721ad9476f0b38af79b, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.419803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.433313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 826/1664] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:59.442617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.442909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.443185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.457584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 839/1665] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:59 2022] PUT /identity/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98/users/4617fec60b8f4721ad9476f0b38af79b/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:59.462450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.496914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:59.498177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:59.595310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1d07c-d743-43a2-a5ec-4633c226d59f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.614750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.615853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.617112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.617620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.618915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.623118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.644039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 827/1666] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:09:59.645498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 840/1667] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:09:59 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:09:59.645652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.646723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.666907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd328c-79bd-4b68-977f-dd778888b5a0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.670215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbba2481-ccc7-4000-9027-95a6d9438df5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.678944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.679177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.679638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.679922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.680199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] PATH_INFO: `/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98/users/4617fec60b8f4721ad9476f0b38af79b/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.680701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.681242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.681648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.682493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:09:59.683057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.686044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.686739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ea7b18f85d70428b9d9f8e64722b5e98, user_id=4617fec60b8f4721ad9476f0b38af79b, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.689619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62a46f8-0695-4ef6-965b-240d0045bc55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.712020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 841/1668] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:09:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:09:59.719325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:09:59.721487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 828/1669] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:09:59 2022] PUT /identity/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98/users/4617fec60b8f4721ad9476f0b38af79b/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:09:59.731686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.731977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.732245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.746576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93f5c00-1633-4c71-b49e-c7f83dd184ed admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:09:59.801540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] MFA Rules not processed for user `4617fec60b8f4721ad9476f0b38af79b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:09:59.803858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:09:59.821699 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:59.846146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:09:59.858864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:09:59.859488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:09:59.859949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:09:59.860582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:09:59.861929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:09:59.864016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:09:59.912159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 842/1670] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:09:59 2022] POST /identity/v3/projects => generated 365 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:09:59.918416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.020440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 829/1671] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:09:59 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 290 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:00.025035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.030983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:00.046108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc8168b-7a87-41f7-8eda-7ba71be303f9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.069123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.069950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.070257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.071414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.071414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.073910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.122546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 843/1672] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:09:59 2022] POST /identity/v3/users => generated 283 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:00.126281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.149119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27637c6-7597-4bb0-92ee-a083c0efc3b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.162990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.163688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.163973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.164245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.165078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.169702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.205507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 844/1673] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:00.211819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.212656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4adbfb-c7f2-43c1-9051-f7ba0656e7ea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.236026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b802e8ec-e033-495b-8e5f-8ba60c1107e8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.257303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.257777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.258047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.258321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.259037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.260695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.290795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 845/1674] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:00 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:00.293313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.324877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023aa806-534e-4d57-8496-87d1665eb880 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.330517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.334041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.334551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.334918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.335858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.336556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.336840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.337121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] PATH_INFO: `/v3/projects/15c7895cbbfb48a7a2da62333bb184e3/users/32aa7a1865444976a0e6e5685636c409/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.372520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15c7895cbbfb48a7a2da62333bb184e3, user_id=32aa7a1865444976a0e6e5685636c409, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.375406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c15443c-806a-4172-bbc9-46207afd0da8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.417644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 846/1675] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:00 2022] PUT /identity/v3/projects/15c7895cbbfb48a7a2da62333bb184e3/users/32aa7a1865444976a0e6e5685636c409/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:00.421386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.421876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.424017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.496878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] MFA Rules not processed for user `32aa7a1865444976a0e6e5685636c409`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:00.499006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:00.522897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.524517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.545804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 830/1676] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:00 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:00.710273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 847/1677] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:00 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:00.718878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.738534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:00.745950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:00.755525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0a98aa-a90a-40d7-b468-252f2de36b2a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.765666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:00.830157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:00.944403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.945315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.945738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.946158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.946970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:00.950618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:00.978808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9761760-fad5-4a49-a54e-f68d4fda02df None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:00.995370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:00.996182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:00.996682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:00.997009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] PATH_INFO: `/v3/projects/97027b0fa5a6437f8f305c2a93d723d2` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:00.998434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] RBAC: Authorizing `identity:delete_project(project_id=97027b0fa5a6437f8f305c2a93d723d2)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.010473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.023808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 831/1678] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:00 2022] POST /identity/v3/projects => generated 363 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:01.025933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.031833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.143392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97027b0fa5a6437f8f305c2a93d723d2', 'request_id': 'req-fcf19552-e211-48ac-93bd-67ef10ea490a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.165629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97027b0fa5a6437f8f305c2a93d723d2', 'request_id': 'req-fcf19552-e211-48ac-93bd-67ef10ea490a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.172354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97027b0fa5a6437f8f305c2a93d723d2', 'request_id': 'req-fcf19552-e211-48ac-93bd-67ef10ea490a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.205239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] The token cache is being invalidate because project 97027b0fa5a6437f8f305c2a93d723d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:01.205566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.208954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.210312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5b1e81-aebc-405c-8c45-a73ce5c01424 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.215432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 848/1679] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:00 2022] DELETE /identity/v3/projects/97027b0fa5a6437f8f305c2a93d723d2 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:01.215432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.217142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.364268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.364927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.365223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.365501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] PATH_INFO: `/v3/users/821d9beabafc4a988cdf7b6d71214ffc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.372115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=821d9beabafc4a988cdf7b6d71214ffc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.378998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.394694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf19552-e211-48ac-93bd-67ef10ea490a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.408784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.409359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.409744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.409909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.410554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.418619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6734bc-f47e-4c4c-88d2-037dee209608 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.480202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 849/1680] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:01 2022] POST /identity/v3/users => generated 288 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:01.485337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.487793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.488097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.498835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '821d9beabafc4a988cdf7b6d71214ffc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.514735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:01.521836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '821d9beabafc4a988cdf7b6d71214ffc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.564962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '821d9beabafc4a988cdf7b6d71214ffc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.566191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '821d9beabafc4a988cdf7b6d71214ffc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.576844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] MFA Rules not processed for user `5ed5cf12b4354c7d88fe6e69f15cf335`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:01.582044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.586935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4d9034f6-b8b0-48c0-bf4c-9835ba91dc92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '821d9beabafc4a988cdf7b6d71214ffc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:01.605791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 832/1681] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:01 2022] DELETE /identity/v3/users/821d9beabafc4a988cdf7b6d71214ffc => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:01.609133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.610355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.612279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.628609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:01.683318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:01.686260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.807198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 850/1682] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:01.809225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.812667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.843258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63e0b24-796d-4727-9d53-dad8d0b897e5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.858333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 833/1683] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:01.858333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:01.858596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.858596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.858596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.858596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.858839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.860230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbd3b41-0947-4dd5-97b3-e28171767e8d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.861440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:01.885370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 851/1684] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:01 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:01.886703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.886988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.887257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.888154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028fed25-5dbb-4b72-a385-bdf2787e10cd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:01.897600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:01.898264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:01.898545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:01.898822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] PATH_INFO: `/v3/users/e99e34a50574453d810708974510bd71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:01.904212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=e99e34a50574453d810708974510bd71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:01.909240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:01.936052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] MFA Rules not processed for user `5ed5cf12b4354c7d88fe6e69f15cf335`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:01.936052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.006280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e99e34a50574453d810708974510bd71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:02.024702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e99e34a50574453d810708974510bd71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:02.055731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e99e34a50574453d810708974510bd71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:02.056146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e99e34a50574453d810708974510bd71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:02.074317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-89ebcd7c-4a2a-4730-994b-04842bc0ce9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e99e34a50574453d810708974510bd71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:02.085737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 834/1685] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:01 2022] DELETE /identity/v3/users/e99e34a50574453d810708974510bd71 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:02.087088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.087380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.087661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.108116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 852/1686] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:02.111946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.117929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.142777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:02.144023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.144388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f243c0a1-6806-4872-817b-7e7c66cb4ee2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.249610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.250344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.250676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.252919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] PATH_INFO: `/v3/projects/e833e703526b47699fa4c338d82fc96d/users/ce09035085e74502be49c5295ce4855d/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.269250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.279951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e833e703526b47699fa4c338d82fc96d, user_id=ce09035085e74502be49c5295ce4855d, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.287252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348fffae-e99f-4504-9f84-597e07c58499 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.310838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 853/1687] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:02 2022] PUT /identity/v3/projects/e833e703526b47699fa4c338d82fc96d/users/ce09035085e74502be49c5295ce4855d/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:02.310838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.310838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.310838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.317630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 835/1688] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:02.318714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.323910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.379984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:02.382211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.436653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.483084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc039f3-d17e-4af0-8efc-3178d7bf5435 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.539551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 854/1689] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:02.540772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.560941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d742d02f-89c6-4243-bcde-a9c7e669bda2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.576130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.576759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.577097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.577443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.578100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.583039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.593458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.594157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.598424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.598761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.601075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.611426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 855/1690] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:02.616625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.639944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b153d3-7788-49b7-a475-fcca50dfffcd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.655889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.656588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.656817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.657096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.658023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:02.658330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.662614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.702519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 856/1691] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:02.703904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.711759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:02.714149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.716584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.731015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 836/1692] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:02.732167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.757421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f419890f-057d-485d-9714-ce23f424d935 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:02.772446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:02.773135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:02.773444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:02.773721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] PATH_INFO: `/v3/projects/e833e703526b47699fa4c338d82fc96d/users/ce09035085e74502be49c5295ce4855d/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:02.785600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e833e703526b47699fa4c338d82fc96d, user_id=ce09035085e74502be49c5295ce4855d, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:02.785910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:02.827121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 837/1693] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:02 2022] PUT /identity/v3/projects/e833e703526b47699fa4c338d82fc96d/users/ce09035085e74502be49c5295ce4855d/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:02.828122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:02.852610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:02.868743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299ce559-5468-4cff-b53d-34d48537afac admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.013953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d180625-170a-4ef4-b994-c348aa92e000 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.016128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.016974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.017401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.017785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.028371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.029211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.029608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.031251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.032041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.044022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.045933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.046046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b0989d-81ac-4920-a0f7-ac40b7d07684 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.063353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 857/1694] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:03.065767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e29cf-52df-409a-afcf-8796d778913b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.066307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e29cf-52df-409a-afcf-8796d778913b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.066789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735e29cf-52df-409a-afcf-8796d778913b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.103178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-735e29cf-52df-409a-afcf-8796d778913b None None] MFA Rules not processed for user `ce09035085e74502be49c5295ce4855d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:03.105094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-735e29cf-52df-409a-afcf-8796d778913b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.129254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 838/1695] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:02 2022] POST /identity/v3/projects => generated 365 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:03.130916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.239075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:03.277608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256a445-7b81-4489-b0c2-e99cdc428e61 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.279653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 858/1696] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:03.281219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77116-234f-4739-867d-2f04790cae5e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.281576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77116-234f-4739-867d-2f04790cae5e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.281918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca77116-234f-4739-867d-2f04790cae5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.300787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.303180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.303604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.305487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.307020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.310836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.340312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dca77116-234f-4739-867d-2f04790cae5e None None] MFA Rules not processed for user `21b1739c7e9945639af536a9652a49e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:03.344556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dca77116-234f-4739-867d-2f04790cae5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.368768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 839/1697] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:03 2022] POST /identity/v3/users => generated 283 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:03.370470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.375299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.518143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43c22da-e031-46a9-abc1-3fadd6016668 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.523276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.523954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 859/1698] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:03.524136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.524620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.525018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.525473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca77116-234f-4739-867d-2f04790cae5e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.539121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca77116-234f-4739-867d-2f04790cae5e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.544740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.545578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.546719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.547128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.548301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.550408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89349baf-cc32-4910-89e6-2f1fa6b5fc14 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.564172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 860/1699] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:03.566276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.567478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.567931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.578754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:03.611068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] MFA Rules not processed for user `21b1739c7e9945639af536a9652a49e7`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:03.612356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.622564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 861/1700] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:03.623704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.644171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.646883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.654883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474ebd7-f577-4484-98e0-7395f8babce5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.670387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 840/1701] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:03 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:03.672151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.675414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.681329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.682201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.684862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.685392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.686241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.691564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.715722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 862/1702] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:03 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:03.719204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.726345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.755899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ccc32-df85-46cf-988a-8bb6fdc4caa2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.771923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:03.772959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:03.773270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:03.773551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] PATH_INFO: `/v3/projects/5c900426e4de40468379ce2a5d0f736b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:03.775172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c900426e4de40468379ce2a5d0f736b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:03.777112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:03.889006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac2422-89f5-41ce-b36b-72e7d762cf3d service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:03.889499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c900426e4de40468379ce2a5d0f736b', 'request_id': 'req-3788f4ef-371b-447e-91be-9dedd59f7358'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:03.903123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c900426e4de40468379ce2a5d0f736b', 'request_id': 'req-3788f4ef-371b-447e-91be-9dedd59f7358'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:03.913869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c900426e4de40468379ce2a5d0f736b', 'request_id': 'req-3788f4ef-371b-447e-91be-9dedd59f7358'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:03.929818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] The token cache is being invalidate because project 5c900426e4de40468379ce2a5d0f736b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:03.930627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:03.931461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:03.936379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 863/1703] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:03 2022] DELETE /identity/v3/projects/5c900426e4de40468379ce2a5d0f736b => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:03.937487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:03.939469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:03.991386 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:04.042177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788f4ef-371b-447e-91be-9dedd59f7358 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:04.094671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:04.102597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.103093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.103285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:04.103775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.105492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.106209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.106845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.107130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] PATH_INFO: `/v3/projects/1bee07b6a69c46a99848a3cb51a2a055/users/ce6a734786304c7bb047b8d66ac0fece/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.147579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bee07b6a69c46a99848a3cb51a2a055, user_id=ce6a734786304c7bb047b8d66ac0fece, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:04.151737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:04.178704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 864/1704] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:03 2022] PUT /identity/v3/projects/1bee07b6a69c46a99848a3cb51a2a055/users/ce6a734786304c7bb047b8d66ac0fece/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:04.181146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:04.183038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.288889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:04.293984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:04.332230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 841/1705] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 661 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:04.335054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:04.338514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-540d3a2e-9e25-4426-9057-5761762b165d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:04.340221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.350258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:04.351974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.352262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.354697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.357890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.366764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1368a2e2-d50b-4976-92e4-fae8c75d2b6f service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:04.378155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:04.534319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:04.535865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d72ec6b-4dc8-4fc9-9d19-804cec3c6a1d service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:04.555608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 865/1706] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:04.557331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.565425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.565858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.609712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:04.610604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.611029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.611449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] PATH_INFO: `/v3/users/588d3307175140a6bb0822bbe3db7ab0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.616102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=588d3307175140a6bb0822bbe3db7ab0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:04.619982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:04.643655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] MFA Rules not processed for user `ce6a734786304c7bb047b8d66ac0fece`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:04.644889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.741707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '588d3307175140a6bb0822bbe3db7ab0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:04.765524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '588d3307175140a6bb0822bbe3db7ab0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:04.796464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '588d3307175140a6bb0822bbe3db7ab0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:04.798007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '588d3307175140a6bb0822bbe3db7ab0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:04.817608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7fb875aa-6ba6-405b-abd4-dcf4b32c8cb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '588d3307175140a6bb0822bbe3db7ab0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:04.831138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 842/1707] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:04 2022] DELETE /identity/v3/users/588d3307175140a6bb0822bbe3db7ab0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:04.832905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7b91-1bfd-4906-9dae-d8b846840eb5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.833219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7b91-1bfd-4906-9dae-d8b846840eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.834922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c7b91-1bfd-4906-9dae-d8b846840eb5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.838529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 843/1708] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 05:10:04 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:10:04.849386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.849745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.849994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.851412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 866/1709] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:04.857733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:04.871995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:04.880300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3da0f3f-c6d0-4539-903f-5d86453cff77 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:04.957409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:04.958833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:04.996102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:04.996961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:04.997429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:04.997862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:04.998837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.000940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.045503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 867/1710] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:04 2022] POST /identity/v3/projects => generated 363 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:05.050415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.054153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:05.093976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 844/1711] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:10:04 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:05.109032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.112422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:05.127022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a040c9-5d9f-46a0-9bde-806c5982a266 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.168436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:05.278030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.278796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.279244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.279641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.294096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.295713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.315674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0602f094-0758-4717-b667-bc9599391ac9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.327916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.330462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 845/1712] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:05.330842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.331202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.331483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.332009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.332220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.337985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:05.348889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.388723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989530ea-ea7f-496c-9f1f-a4d1578390b9 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.402064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.403140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.403799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.404465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] PATH_INFO: `/v3/projects/6e655d2d79ba47aeb65c06a8b8ec9f8a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.406356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e655d2d79ba47aeb65c06a8b8ec9f8a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.409261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.420546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 868/1713] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:05 2022] POST /identity/v3/users => generated 288 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:05.424874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.439748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b95b2b-c78c-4db7-a019-f560709a8f87 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.453022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.454074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.454649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.455065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.455859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.458413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.484119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 869/1714] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:05.488870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.505643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e655d2d79ba47aeb65c06a8b8ec9f8a', 'request_id': 'req-775930dd-2c3e-4780-aa4a-9426025ee5e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:05.506979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1307d373-7231-4c0b-989b-18ef4ed28132 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.557363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e655d2d79ba47aeb65c06a8b8ec9f8a', 'request_id': 'req-775930dd-2c3e-4780-aa4a-9426025ee5e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:05.580128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e655d2d79ba47aeb65c06a8b8ec9f8a', 'request_id': 'req-775930dd-2c3e-4780-aa4a-9426025ee5e3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:05.608771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] The token cache is being invalidate because project 6e655d2d79ba47aeb65c06a8b8ec9f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:05.609087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:05.609771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:05.620629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 846/1715] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:05 2022] DELETE /identity/v3/projects/6e655d2d79ba47aeb65c06a8b8ec9f8a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:05.621652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.623151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:05.745245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.748580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.748964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.751827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] PATH_INFO: `/v3/projects/c8509cc916fd4cfeb148a534babd008c/users/924c30ee1530416bab1792f00b241da2/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.788083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:05.815675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8509cc916fd4cfeb148a534babd008c, user_id=924c30ee1530416bab1792f00b241da2, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.818713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.831077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775930dd-2c3e-4780-aa4a-9426025ee5e3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:05.837956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:05.838911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:05.839437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:05.839907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] PATH_INFO: `/v3/users/4617fec60b8f4721ad9476f0b38af79b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:05.841591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4617fec60b8f4721ad9476f0b38af79b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:05.844093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:05.865427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 870/1716] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:05 2022] PUT /identity/v3/projects/c8509cc916fd4cfeb148a534babd008c/users/924c30ee1530416bab1792f00b241da2/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:05.870755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:05.873063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.007540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4617fec60b8f4721ad9476f0b38af79b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:06.012701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:06.021509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4617fec60b8f4721ad9476f0b38af79b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:06.064611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4617fec60b8f4721ad9476f0b38af79b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:06.070386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4617fec60b8f4721ad9476f0b38af79b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:06.080783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f1789f-9696-4918-be4b-b1407aeab1df admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:06.091708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4617fec60b8f4721ad9476f0b38af79b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:06.092685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:06.093438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.093697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.093953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.095048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:06.096482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d952c6-4191-4c2c-86e3-a392ae30ec49 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:06.111017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 847/1717] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:05 2022] DELETE /identity/v3/users/4617fec60b8f4721ad9476f0b38af79b => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:06.127318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 871/1718] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:05 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:06.131565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:06.133157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.227063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdecf-6971-4eda-8bcc-7daedbb58612 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.227469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdecf-6971-4eda-8bcc-7daedbb58612 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.227747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6cdecf-6971-4eda-8bcc-7daedbb58612 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.229687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 872/1719] 10.222.0.43 () {54 vars in 912 bytes} [Thu Sep 1 05:10:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:10:06.253419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.254011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.254179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.316620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:06.318752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.348231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738176a4-9e92-44fb-92b7-0e576e8af8d3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:06.375690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:06.377925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.378211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.378486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] PATH_INFO: `/v3/projects/c8509cc916fd4cfeb148a534babd008c/users/924c30ee1530416bab1792f00b241da2/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.381112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8509cc916fd4cfeb148a534babd008c, user_id=924c30ee1530416bab1792f00b241da2, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:06.384254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28147d7-09ea-4872-9ccb-2a0b17c72ac8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:06.423801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 848/1720] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:06 2022] PUT /identity/v3/projects/c8509cc916fd4cfeb148a534babd008c/users/924c30ee1530416bab1792f00b241da2/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:06.427128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.427434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.427751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.489835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] MFA Rules not processed for user `924c30ee1530416bab1792f00b241da2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:06.491157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.500493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 873/1721] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:10:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:06.549639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:06.551439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.575010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfea433-a21d-4980-920c-e5cf7e729508 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:06.649627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 849/1722] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:06 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:06.663379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:06.664989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:06.779363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:06.779916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.780192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.780467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.796844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:06.799694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:06.801697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:06.814683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fcb4f8-a1f8-48de-8fcb-c0b5cee706f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:06.826032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 874/1723] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:06.836066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:06.836712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:06.836992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:06.837303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:06.869734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:06.876329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:06.929634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 850/1724] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:07.242220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:07.246028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:07.401832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:07.462269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42a0cdf-8d31-424c-84a0-18485ebaefe6 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:07.489890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:07.490519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:07.490805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:07.491079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] PATH_INFO: `/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:07.498289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c0b7fbf3209d46f39e25a86bcfdc04b1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:07.500721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:07.608123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c0b7fbf3209d46f39e25a86bcfdc04b1', 'request_id': 'req-97037014-7417-456a-a50d-bea1d5338dc6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:07.621643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:07.623826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:07.624904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c0b7fbf3209d46f39e25a86bcfdc04b1', 'request_id': 'req-97037014-7417-456a-a50d-bea1d5338dc6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:07.635748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c0b7fbf3209d46f39e25a86bcfdc04b1', 'request_id': 'req-97037014-7417-456a-a50d-bea1d5338dc6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:07.652207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] The token cache is being invalidate because project c0b7fbf3209d46f39e25a86bcfdc04b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:07.652834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:07.656254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-97037014-7417-456a-a50d-bea1d5338dc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:07.659509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 875/1725] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:07 2022] DELETE /identity/v3/projects/c0b7fbf3209d46f39e25a86bcfdc04b1 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:07.665774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6049-4d06-46ce-bb4a-214a750809f4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:07.668837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6049-4d06-46ce-bb4a-214a750809f4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:07.668837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be6049-4d06-46ce-bb4a-214a750809f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:07.706045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-77be6049-4d06-46ce-bb4a-214a750809f4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:07.709551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77be6049-4d06-46ce-bb4a-214a750809f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:07.839437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e84bd7da-57a9-46a8-a76d-cd693f39348a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:07.892079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 876/1726] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:07.899149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:07.902673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:07.903115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:07.974830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] MFA Rules not processed for user `5ed5cf12b4354c7d88fe6e69f15cf335`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:07.977735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:07.982918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:07.983762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:07.984705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:07.986053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:07.990553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:08.034188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:08.035713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b386032-b76c-4ff0-abd0-8600f5692568 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:08.080872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 851/1727] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:08.087457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.093227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.093708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:08.160451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:08.162909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:08.187077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 852/1728] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:08.188346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:08.192657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:08.198634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 877/1729] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:07 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:08.199889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:08.245165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef7ce0-116c-42ef-a500-20c0fb9d3855 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:08.246414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80d048f-55eb-41e9-bd54-da960f094954 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:08.263301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:08.264132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.265472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.265952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] PATH_INFO: `/v3/users/ce6a734786304c7bb047b8d66ac0fece` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:08.268437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:08.269070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.273034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6a734786304c7bb047b8d66ac0fece)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:08.273959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.274472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:08.275457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:08.275893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:08.278444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:08.287015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:08.340221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:08.361809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 878/1730] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:08.366264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:08.423620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418bac06-17ba-49e3-8374-60ab1c909bc1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:08.442074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:08.444142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.445366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.448076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:08.450488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:08.461121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:08.505041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6a734786304c7bb047b8d66ac0fece'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:08.542619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6a734786304c7bb047b8d66ac0fece'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:08.600537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 879/1731] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:08 2022] POST /identity/v3/projects => generated 385 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:08.606041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:08.607249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:08.609594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6a734786304c7bb047b8d66ac0fece'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:08.615777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6a734786304c7bb047b8d66ac0fece'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:08.617824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:08.638703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6a734786304c7bb047b8d66ac0fece'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:08.650719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 853/1732] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:08 2022] DELETE /identity/v3/users/ce6a734786304c7bb047b8d66ac0fece => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:08.653057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:08.662263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:08.884159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39e2204-00cc-49f1-bf40-503c3542cd86 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:08.903296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:08.903956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.904289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.904524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:08.905167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:08.907847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca769960-e5e3-4112-ad56-8def7041948a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:08.988410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0fa9f2-a287-4940-861e-a02b04896616 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:08.992639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 854/1733] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:08 2022] POST /identity/v3/users => generated 293 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:08.994421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:08.994799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:08.995096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.021772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:09.022576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.024458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.024998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] PATH_INFO: `/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.029962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ea7b18f85d70428b9d9f8e64722b5e98)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:09.032592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:09.061133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:09.062392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.107730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 855/1734] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:09.108759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:09.115052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.147302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d462248-0b71-41ab-867f-0cb59cb11178 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:09.180137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ea7b18f85d70428b9d9f8e64722b5e98', 'request_id': 'req-e9269850-2715-4487-bfbc-e6d6cb271be1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.200175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ea7b18f85d70428b9d9f8e64722b5e98', 'request_id': 'req-e9269850-2715-4487-bfbc-e6d6cb271be1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.274507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ea7b18f85d70428b9d9f8e64722b5e98', 'request_id': 'req-e9269850-2715-4487-bfbc-e6d6cb271be1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.294057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] The token cache is being invalidate because project ea7b18f85d70428b9d9f8e64722b5e98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:09.294511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.295448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.297598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 880/1735] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:08 2022] DELETE /identity/v3/projects/ea7b18f85d70428b9d9f8e64722b5e98 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:09.298964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:09.301072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.325028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:09.325460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.325739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.326014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] PATH_INFO: `/v3/users/32aa7a1865444976a0e6e5685636c409` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.327821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=32aa7a1865444976a0e6e5685636c409)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:09.338410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:09.400180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9269850-2715-4487-bfbc-e6d6cb271be1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:09.408256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:09.409509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.410053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.410467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.411578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:09.413955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:09.430988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 881/1736] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:09.432820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:09.436280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.445718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:09.470384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '32aa7a1865444976a0e6e5685636c409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.497301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '32aa7a1865444976a0e6e5685636c409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.534665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:09.538903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '32aa7a1865444976a0e6e5685636c409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.549072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '32aa7a1865444976a0e6e5685636c409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.566533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-24e9c355-4f06-4e15-95d0-27034c1c5705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '32aa7a1865444976a0e6e5685636c409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:09.575076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 856/1737] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:09 2022] DELETE /identity/v3/users/32aa7a1865444976a0e6e5685636c409 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:09.576356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.576646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.577013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.587961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560d3e89-38c9-4c45-afe6-35b4ca676f25 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:09.664066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:09.670517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.797867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:09.798893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.800464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.800832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.805970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.845513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 857/1738] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:09.846619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:09.848480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.881716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b75169-6f9e-4bbe-9299-5fc44b283913 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:09.903732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:09.904504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.904788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.905599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.905799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:09.907427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dbc40d-ef47-4408-97d2-905a1823ece6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:09.940277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 858/1739] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:09 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:09.947338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df81c7-65ee-4e01-a5de-1fbf2cd82338 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.947338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df81c7-65ee-4e01-a5de-1fbf2cd82338 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.947338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df81c7-65ee-4e01-a5de-1fbf2cd82338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:09.948590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:09.950832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc680a9-c479-41ca-b818-0eed7c5d4cd9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:09.989303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 882/1740] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 557 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:09.990557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-97df81c7-65ee-4e01-a5de-1fbf2cd82338 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:09.991595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:09.991799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97df81c7-65ee-4e01-a5de-1fbf2cd82338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:09.993803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:09.994515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.018904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 859/1741] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:10.018904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.018904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.018904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.068670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] MFA Rules not processed for user `386e1605489846248e898a62c79643fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:10.070126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:10.073901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:10.076610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:10.097408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 860/1742] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:10.099149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.136254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217cb792-63cc-44e0-8591-d34ee629f55e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:10.151520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:10.155163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.156576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.160374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] PATH_INFO: `/v3/projects/68fba9ef2c6742eda0594112794ba466/users/26c91a6cb25c47e5850589c17db6a0fa/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.208927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68fba9ef2c6742eda0594112794ba466, user_id=26c91a6cb25c47e5850589c17db6a0fa, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:10.211674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:10.244399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 861/1743] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:10 2022] PUT /identity/v3/projects/68fba9ef2c6742eda0594112794ba466/users/26c91a6cb25c47e5850589c17db6a0fa/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:10.246778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.250297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:10.264990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:10.274497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 883/1744] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:09 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:10.275810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.307719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f19160-99c1-49d2-9c21-bcc8da121499 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:10.387748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86f1f29b-304a-40a6-b22b-1beff0c4a442 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:10.400089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:10.400720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.401151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.401453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.441754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:10.442437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.442720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.443510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.444177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:10.444480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:10.447609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5087ec98-7d5f-4845-baaa-241ddbe4a62c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:10.478611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 884/1745] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:10.480309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.480690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.481540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.520761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] MFA Rules not processed for user `26c91a6cb25c47e5850589c17db6a0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:10.522368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:10.528143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:10.551319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:10.553388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:10.571686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 862/1746] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:10.572819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.574652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:10.723803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d97f91-80c2-4e81-9f0f-750e6bb169cf service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:10.737718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:10.738416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.738763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.739125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.758662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 885/1747] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:10.760606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.786369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816f1061-2926-4ac5-89b0-29bc6a6af4fb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:10.801559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:10.802435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:10.802567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:10.802837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:10.803521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:10.811982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:10.883574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:10.886194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 886/1748] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:10 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:10.887945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.906714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:10.935078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 863/1749] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:10 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:10.936260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:10.966817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc62473-9355-4e68-9b80-196d2891bc9b service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.109321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76583de5-4de6-4998-848d-f5d8f6dd9c11 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.113819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.114558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.114945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.115328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.116189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.127200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.136297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.137073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.138655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.139030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.140166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.146919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.158598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:11.197217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 864/1750] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:10 2022] POST /identity/v3/users => generated 294 bytes in 261 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:11.200437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.229413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d910aa04-63a2-4b4d-9079-252b5616d7b4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.256310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 887/1751] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:10 2022] POST /identity/v3/projects => generated 385 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:11.261172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.261826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.263749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.267718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.268127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.269114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.273765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.315266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 865/1752] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:11.316306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.338206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a4c5d1-6e66-4d55-82fa-835034056a7b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.361521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:11.449646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec56eef7-c5d8-4ecc-bfec-93f1fe9eaa1c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.464139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.467441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.467842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.468194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.470800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.474009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.474875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.475339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.475726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.475981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.476807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.478873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.510405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 866/1753] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:11.511418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.542966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 888/1754] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:11 2022] POST /identity/v3/users => generated 299 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:11.544265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.551635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e7acb-164c-44ad-832d-5e96fb3a8664 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.592986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.594226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.594772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.595241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] PATH_INFO: `/v3/projects/0e23427bc66e4694a6d3d47dfe20596e/users/7eddb8f7c1cf4836830ea203672f3653/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.610030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a97c5a0-e0e4-470c-a773-4662b9ce7146 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.629535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.630179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.630462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.630734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.631387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.633006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.672358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e23427bc66e4694a6d3d47dfe20596e, user_id=7eddb8f7c1cf4836830ea203672f3653, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.675720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.684641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 889/1755] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:11 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:11.687837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.690697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:11.719356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 867/1756] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:11 2022] PUT /identity/v3/projects/0e23427bc66e4694a6d3d47dfe20596e/users/7eddb8f7c1cf4836830ea203672f3653/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:11.730612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:11.779144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c5eecc-1b64-4f0d-93a6-705710f5ba9e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:11.958035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:11.958704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:11.958986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:11.959360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] PATH_INFO: `/v3/projects/15c7895cbbfb48a7a2da62333bb184e3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:11.961365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=15c7895cbbfb48a7a2da62333bb184e3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:11.968367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:11.990332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261dd525-ee47-4ac4-ba62-45dff750c9bb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:12.015987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:12.016724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:12.017002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:12.017312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] PATH_INFO: `/v3/projects/1160b193e50d4127acebd3b4a3d6171e/users/2f8925d0d7b047348533a15f081c4cb5/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:12.062615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1160b193e50d4127acebd3b4a3d6171e, user_id=2f8925d0d7b047348533a15f081c4cb5, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:12.065067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd7a472-1394-4dcb-8a1a-76a97faeeee5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:12.130691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 868/1757] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:11 2022] PUT /identity/v3/projects/1160b193e50d4127acebd3b4a3d6171e/users/2f8925d0d7b047348533a15f081c4cb5/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:12.132038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:12.138230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15c7895cbbfb48a7a2da62333bb184e3', 'request_id': 'req-e0aae2df-499c-4060-82a2-6bf91b3eba3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:12.145667 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:12.145949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:12.164427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15c7895cbbfb48a7a2da62333bb184e3', 'request_id': 'req-e0aae2df-499c-4060-82a2-6bf91b3eba3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:12.174100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15c7895cbbfb48a7a2da62333bb184e3', 'request_id': 'req-e0aae2df-499c-4060-82a2-6bf91b3eba3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:12.186784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:12.234244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] The token cache is being invalidate because project 15c7895cbbfb48a7a2da62333bb184e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:12.234553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:12.238237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:12.248415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 890/1758] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:11 2022] DELETE /identity/v3/projects/15c7895cbbfb48a7a2da62333bb184e3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:12.249835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:12.252898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:12.292259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] MFA Rules not processed for user `7eddb8f7c1cf4836830ea203672f3653`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:12.293532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:12.499561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0aae2df-499c-4060-82a2-6bf91b3eba3f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:12.505026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:12.567415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 869/1759] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:12 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:12.567415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:12.573146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:12.744791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:12.747457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:12.747740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:12.748011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] PATH_INFO: `/v3/projects/1bee07b6a69c46a99848a3cb51a2a055` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:12.751283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bee07b6a69c46a99848a3cb51a2a055)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:12.759409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:12.777099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf67c0a5-3573-4698-b15f-6f9f292619a6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:12.789214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:12.790662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:12.790944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:12.791221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:12.791873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:12.794010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:12.865573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 870/1760] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:12 2022] GET /identity/v3/roles => generated 1420 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:12.871187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:12.875900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:12.966415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75ef6d0-f91b-4d23-ac5f-f410ffe8abb7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:12.980042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bee07b6a69c46a99848a3cb51a2a055', 'request_id': 'req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.008745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bee07b6a69c46a99848a3cb51a2a055', 'request_id': 'req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.034557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bee07b6a69c46a99848a3cb51a2a055', 'request_id': 'req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.065331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] The token cache is being invalidate because project 1bee07b6a69c46a99848a3cb51a2a055 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:13.065630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.068876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.072293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 891/1761] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:12 2022] DELETE /identity/v3/projects/1bee07b6a69c46a99848a3cb51a2a055 => generated 0 bytes in 823 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:13.073074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:13.074623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:13.192954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:13.195689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.199809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.200290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] PATH_INFO: `/v3/users/ce09035085e74502be49c5295ce4855d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.205727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce09035085e74502be49c5295ce4855d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:13.210211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:13.222127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:13.278550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c706ee0-80c9-463d-8d5d-6ff9d4a1d716 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:13.285780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:13.286420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.286711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.286985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.287975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:13.290571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:13.329764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce09035085e74502be49c5295ce4855d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.345046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 892/1762] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:13 2022] POST /identity/v3/projects => generated 385 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:13.347900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:13.348448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce09035085e74502be49c5295ce4855d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.350042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:13.397573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce09035085e74502be49c5295ce4855d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.405705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce09035085e74502be49c5295ce4855d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.424861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0a70d54d-b1e4-43d0-bd66-7717c40cf181 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce09035085e74502be49c5295ce4855d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.439879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 871/1763] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:12 2022] DELETE /identity/v3/users/ce09035085e74502be49c5295ce4855d => generated 0 bytes in 576 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:13.442225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.442813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.443167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.465465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:13.482402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88aa3b25-a865-4bf1-a69e-98f105de50dd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:13.522826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:13.525247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:13.621463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:13.622392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.622681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.623051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] PATH_INFO: `/v3/projects/1160b193e50d4127acebd3b4a3d6171e/users/2f8925d0d7b047348533a15f081c4cb5/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.626502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1160b193e50d4127acebd3b4a3d6171e, user_id=2f8925d0d7b047348533a15f081c4cb5, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:13.635376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:13.636039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 872/1764] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:13.637109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:13.642400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:13.680567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 893/1765] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:13 2022] PUT /identity/v3/projects/1160b193e50d4127acebd3b4a3d6171e/users/2f8925d0d7b047348533a15f081c4cb5/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:13.682909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:13.687583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:13.698429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eafce5fc-19e0-445b-8ba2-03a625337a0b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:13.776026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:13.776728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.777010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.777335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] PATH_INFO: `/v3/users/924c30ee1530416bab1792f00b241da2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.778668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=924c30ee1530416bab1792f00b241da2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:13.805023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:13.883039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba063e6f-a70a-48fa-bef3-1c66544dac36 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:13.899838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:13.901663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.901948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.903812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.905486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:13.911070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c2dd59-aa6f-412e-a431-74741fae5ecb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:13.941521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:13.947966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '924c30ee1530416bab1792f00b241da2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.964499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '924c30ee1530416bab1792f00b241da2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.981993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 894/1766] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:13 2022] POST /identity/v3/users => generated 299 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:13.984258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:13.984551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:13.984827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:13.995787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '924c30ee1530416bab1792f00b241da2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:13.999029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '924c30ee1530416bab1792f00b241da2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:14.022022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '924c30ee1530416bab1792f00b241da2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:14.024130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:14.031450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 873/1767] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:13 2022] DELETE /identity/v3/users/924c30ee1530416bab1792f00b241da2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:14.032965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.034780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.083999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] MFA Rules not processed for user `2f8925d0d7b047348533a15f081c4cb5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:14.098749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.190729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0b1e63-cb04-44db-a05f-c37cee3d7b62 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.225549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.226528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.226961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.228823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.229811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.232928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.258036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 895/1768] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:13 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:14.259761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.261479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.275121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 874/1769] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:14.276444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.288428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.405568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40915db6-da7b-4476-9a9c-29b216c94c57 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.416395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.417194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.418061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.418433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.422566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.445531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8975a2d6-5f31-4a7f-979f-312db1053b1c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.450514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.451337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.451732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.452108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.464938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.470455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.503871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 875/1770] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:14 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:14.505078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.539075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10815874-b789-484e-acb3-8990a52aaf95 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.545003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.546074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.546524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.546942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] PATH_INFO: `/v3/projects/b4ad88f4272d416988faee6ad8357c01/users/c2b7bbe2d0474417b1d2cc0f3615544a/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.571775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.576539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ad88f4272d416988faee6ad8357c01, user_id=c2b7bbe2d0474417b1d2cc0f3615544a, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.577726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1409f4ce-03bc-4b49-924c-61569cc261c3 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.581609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.583213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:14.595714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 896/1771] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:10:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:10:14.598491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.599166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.599708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.616429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 876/1772] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:14 2022] PUT /identity/v3/projects/b4ad88f4272d416988faee6ad8357c01/users/c2b7bbe2d0474417b1d2cc0f3615544a/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:14.628270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:14.633635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.635260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.789610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 897/1773] 10.222.0.50 () {58 vars in 1015 bytes} [Thu Sep 1 05:10:14 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:14.789610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.789610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:14.807757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7678c5f5-6faf-4c2e-bbc4-8d5331af28ce admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.820975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.821699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.822026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.822335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.824565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd21ce8-3c82-4b70-9c97-9158df9b5271 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.825280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.827923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.840048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.840908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.840908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.841165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] PATH_INFO: `/v3/users/26c91a6cb25c47e5850589c17db6a0fa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.850298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 877/1774] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:14 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:14.851322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26c91a6cb25c47e5850589c17db6a0fa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.855292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.859313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:14.894822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b704ff8-3584-485a-a9b9-01bdb056ecbb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:14.902465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:14.903990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.904288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.904567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] PATH_INFO: `/v3/projects/b4ad88f4272d416988faee6ad8357c01/users/c2b7bbe2d0474417b1d2cc0f3615544a/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:14.906649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4ad88f4272d416988faee6ad8357c01, user_id=c2b7bbe2d0474417b1d2cc0f3615544a, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:14.911022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3961c77-08e4-40cf-85c4-aa57f4128fde admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:14.924069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:14.984006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 878/1775] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:14 2022] PUT /identity/v3/projects/b4ad88f4272d416988faee6ad8357c01/users/c2b7bbe2d0474417b1d2cc0f3615544a/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:14.984006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f12e-1253-4051-aac5-bc74af0197f6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:14.984006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f12e-1253-4051-aac5-bc74af0197f6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:14.984006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5f12e-1253-4051-aac5-bc74af0197f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:15.004522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26c91a6cb25c47e5850589c17db6a0fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.020253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26c91a6cb25c47e5850589c17db6a0fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.033643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26c91a6cb25c47e5850589c17db6a0fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.034714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26c91a6cb25c47e5850589c17db6a0fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.072175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26c91a6cb25c47e5850589c17db6a0fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.103728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 898/1776] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:14 2022] DELETE /identity/v3/users/26c91a6cb25c47e5850589c17db6a0fa => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:15.105979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:15.112909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.164910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ae5f12e-1253-4051-aac5-bc74af0197f6 None None] MFA Rules not processed for user `6efb292e19dc445b9b01e455fa2befec`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:15.171313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ae5f12e-1253-4051-aac5-bc74af0197f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.287501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1fe5dc-1a46-45d6-8a0c-e5f4d0caa827 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:15.315195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:15.315880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:15.316162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:15.316434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:15.327084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.371013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:15.375139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e214888-9e5a-4540-8b56-573e47033b24 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:15.400487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 899/1777] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:15.403807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:15.404107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:15.404432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:15.413677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 879/1778] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 437 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:15.414997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:15.415289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:15.415562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:15.503107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:15.504358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] MFA Rules not processed for user `c2b7bbe2d0474417b1d2cc0f3615544a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:15.504473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.507979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.537328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:15.727750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 900/1779] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:15.727750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:15.728677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.741313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 880/1780] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:15.742304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:15.746827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:15.761114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a04df39-83b6-4d98-8c9b-465ad185c096 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:15.772366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:15.773037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:15.774658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:15.774942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] PATH_INFO: `/v3/projects/c8509cc916fd4cfeb148a534babd008c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:15.779898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8509cc916fd4cfeb148a534babd008c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:15.794602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:15.899378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1351d7-e7cf-49a2-8217-438fbdbcebfd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:15.937106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8509cc916fd4cfeb148a534babd008c', 'request_id': 'req-737d6590-91e4-470a-a553-3091a7c50853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.952584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8509cc916fd4cfeb148a534babd008c', 'request_id': 'req-737d6590-91e4-470a-a553-3091a7c50853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.961302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:15.963028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8509cc916fd4cfeb148a534babd008c', 'request_id': 'req-737d6590-91e4-470a-a553-3091a7c50853'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.977611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] The token cache is being invalidate because project c8509cc916fd4cfeb148a534babd008c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:15.977930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.978787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:15.981088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 901/1781] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:15 2022] DELETE /identity/v3/projects/c8509cc916fd4cfeb148a534babd008c => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:15.981984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:15.983415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.102756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737d6590-91e4-470a-a553-3091a7c50853 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:16.107893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.108536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.108827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.109100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.117509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.150102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.150102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.150102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.150102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.152495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.214147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:16.266014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.281589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.316779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 902/1782] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:16.318013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:16.319664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.400190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.405665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5cf40-c978-4a91-8ae0-741267f67361 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.435470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 881/1783] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:16.439558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.440674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.441385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.497133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:16.503271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.507154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf876380-5e2e-4cc0-af0a-224934d6a5e7 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:16.525881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.530873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.531730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.532598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.545965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.723544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.725290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 882/1784] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:16.726189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:16.727710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.734757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45972142-3366-486f-8d66-b273a4d86890 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.752697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 903/1785] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:16.754251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.754453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04ae0b-85a2-4a38-b941-8b4fbfc67831 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:16.754949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.755364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.771349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.772043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.772333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.772609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] PATH_INFO: `/v3/users/7eddb8f7c1cf4836830ea203672f3653` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.774023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7eddb8f7c1cf4836830ea203672f3653)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.776157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.791360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:16.793738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:16.805701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 904/1786] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:16.809396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:16.822752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61490fe2-8aba-4165-b5e3-045443c65185 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:16.836743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.838081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.838369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.838643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.839780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:16.840118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.842308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.860637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 905/1787] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:10:16.865167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:16.884924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c1ac4-c605-4ef2-9cd4-e2cf3b4abcdc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:16.903269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:16.906123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:16.906123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:16.906630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:16.909115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:16.911596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:16.941306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7eddb8f7c1cf4836830ea203672f3653'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:16.970922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 906/1788] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:16 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:16.971209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7eddb8f7c1cf4836830ea203672f3653'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:16.973098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:16.975070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.022603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7eddb8f7c1cf4836830ea203672f3653'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.029542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7eddb8f7c1cf4836830ea203672f3653'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.042511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a05e8da6-33ce-43aa-97bb-41bc86d289e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7eddb8f7c1cf4836830ea203672f3653'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.053650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 883/1789] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:16 2022] DELETE /identity/v3/users/7eddb8f7c1cf4836830ea203672f3653 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:17.055669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.056124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.056586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.102400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:17.107347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.109696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:17.164235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6f23ea-e5c3-4c8f-9148-2fc8c98b4932 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.286726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 884/1790] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:17.290652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.296521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.323429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597fec9-8d53-4543-94ac-83b3ba5242ce None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.334169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.335309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.336462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.337811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.338469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.338884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.338996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] PATH_INFO: `/v3/projects/e833e703526b47699fa4c338d82fc96d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.339726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.341320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.343430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e833e703526b47699fa4c338d82fc96d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.347690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:17.350282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:17.427223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 907/1791] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:16 2022] POST /identity/v3/users => generated 289 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:17.430460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.437228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.492251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e833e703526b47699fa4c338d82fc96d', 'request_id': 'req-55a617ad-0239-420f-af94-ba2feec56778'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.509944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e833e703526b47699fa4c338d82fc96d', 'request_id': 'req-55a617ad-0239-420f-af94-ba2feec56778'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.528036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e833e703526b47699fa4c338d82fc96d', 'request_id': 'req-55a617ad-0239-420f-af94-ba2feec56778'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.555473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] The token cache is being invalidate because project e833e703526b47699fa4c338d82fc96d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:17.556625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.558404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:17.568710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 885/1792] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:17 2022] DELETE /identity/v3/projects/e833e703526b47699fa4c338d82fc96d => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:17.570062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.573787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.632983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26cf49b-31fd-44f9-b957-dc75bf54f3ec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.688856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:17.704935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a617ad-0239-420f-af94-ba2feec56778 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.712998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.714425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.715420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.716536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.721644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.723634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d3b782-759e-462b-b529-5bac181f6c54 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:17.754803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 886/1793] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:17.756564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279801-bdf9-4716-8bb3-12a6c55227b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.756853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279801-bdf9-4716-8bb3-12a6c55227b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.757132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96279801-bdf9-4716-8bb3-12a6c55227b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.783953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.785440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.786018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.786489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.792220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.806813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-96279801-bdf9-4716-8bb3-12a6c55227b9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:17.808461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96279801-bdf9-4716-8bb3-12a6c55227b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.830252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.831720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0101c3b-4438-4e21-a879-4bca34a22d8f service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:17.833414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 887/1794] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:17.839130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42709-cb6c-4d9e-9007-2c8638a12520 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.842989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42709-cb6c-4d9e-9007-2c8638a12520 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.845111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd42709-cb6c-4d9e-9007-2c8638a12520 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.853303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 888/1795] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:10:17 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:10:17.856962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42709-cb6c-4d9e-9007-2c8638a12520 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.866359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 908/1796] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:17.867619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.867909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.868188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.910980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:17.917264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bd42709-cb6c-4d9e-9007-2c8638a12520 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.917597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:17.940554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.941211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.944898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.945611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.949134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.954038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 909/1797] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:17.954907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.958017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:17.968102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf02e44-3190-47ee-8ee8-4f4dd406630d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:17.980082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 889/1798] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:17 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:17.982918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:17.984593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:17.986408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:17.986732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:17.987012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:17.987686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:17.987992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:17.991157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:18.016949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e0d995-4bf0-474d-bc43-a848468d7387 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:18.027403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 910/1799] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:18.028235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:18.033965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:18.037786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.037974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.038245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] PATH_INFO: `/v3/projects/0baf00702c3941a086061a68bccb4f33/users/8f655da9366f4c5b942e784c9d715195/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.051380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf96df-5f2d-42fd-b0d3-1db4743b0592 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:18.070394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:18.071258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.071561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.071807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.072463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:18.074469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8af4131-c24d-4c2a-97bc-990bc437bd78 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:18.091990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=0baf00702c3941a086061a68bccb4f33, user_id=8f655da9366f4c5b942e784c9d715195, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:18.105651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:18.142487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:18.163141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 911/1800] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:18 2022] POST /identity/v3/projects => generated 369 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:18.164003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11920-5696-4f38-b571-844c3724453f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.164293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11920-5696-4f38-b571-844c3724453f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.164573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a11920-5696-4f38-b571-844c3724453f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.165333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 890/1801] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:17 2022] PUT /identity/v3/projects/0baf00702c3941a086061a68bccb4f33/users/8f655da9366f4c5b942e784c9d715195/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:18.168562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:18.211643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b1a11920-5696-4f38-b571-844c3724453f None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:18.214264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1a11920-5696-4f38-b571-844c3724453f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:18.339741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a704ea62-54bc-491b-9a1d-29cb269b5edb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:18.451222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 912/1802] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:10:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:18.452561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.452853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.453132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.547222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:18.548123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.548516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.548888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.549682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:18.555831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:18.642320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] MFA Rules not processed for user `8f655da9366f4c5b942e784c9d715195`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:18.645401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 891/1803] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:18 2022] POST /identity/v3/users => generated 285 bytes in 479 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:18.646455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:18.649395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:18.652294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:18.709807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888b810e-e4cb-45c0-a7e3-5d51bd9d8705 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:18.740522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:18.741486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.741838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.742210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.784138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:18.786022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:18.837789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 892/1804] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:18.866213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:18.931187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3d352-6f9b-4649-a3ca-8f97ac3a305a service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:18.956901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:18.960491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:18.962286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:18.962761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:18.965684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:18.967583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.007671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 893/1805] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:18 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:19.014251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.059094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 913/1806] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 605 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:19.061120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.067735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19c82ea-11da-4d9d-b255-9a615bfc312e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:19.088061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:19.088741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.089027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.089336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.089991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:19.091603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.120062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03606302-776f-46a4-ac2c-0a07c8307adb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:19.150225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:19.150854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.150854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.155174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 894/1807] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:19.155309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.156106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:19.160642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.165061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.215456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e808d0-e9b6-45ae-ae84-ec7734160371 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:19.236471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:19.237414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.238679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.240181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] PATH_INFO: `/v3/projects/b930382969244a24a7a6d5f23fc8b983/users/1b7a52256a54483da4b3fda79fa04c83/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.267115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 914/1808] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:19 2022] POST /identity/v3/projects => generated 375 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:19.270829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.320917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:19.350583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b930382969244a24a7a6d5f23fc8b983, user_id=1b7a52256a54483da4b3fda79fa04c83, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:19.366176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65640dec-b305-4007-8c91-3072f3f1387b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.431303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 895/1809] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:19 2022] PUT /identity/v3/projects/b930382969244a24a7a6d5f23fc8b983/users/1b7a52256a54483da4b3fda79fa04c83/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:19.436217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43695e-df97-46d7-9608-670131832609 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.439596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43695e-df97-46d7-9608-670131832609 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.440122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb43695e-df97-46d7-9608-670131832609 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.508980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cb43695e-df97-46d7-9608-670131832609 None None] MFA Rules not processed for user `1b7a52256a54483da4b3fda79fa04c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:19.510890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb43695e-df97-46d7-9608-670131832609 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:19.634730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c8f45f-9199-45c3-afc0-5fc46757d442 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:19.634730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:19.712840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 896/1810] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:19.714588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43695e-df97-46d7-9608-670131832609 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.869083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb43695e-df97-46d7-9608-670131832609 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:19.869392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:19.870058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.870388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.870669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.871376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:19.881509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:19.884024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:19.886669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:19.887041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:19.891752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:19.894795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.896150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:19.950478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 915/1811] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:19 2022] POST /identity/v3/users => generated 294 bytes in 675 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:19.950478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:19.988538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 897/1812] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:19 2022] POST /identity/v3/projects => generated 369 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:19.995229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.042088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb931b3-5d74-48c1-b625-0dba85dd2a67 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.220891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.221584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.221796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.222066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.222984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.225775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.236159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bf1355-80da-4eee-9d5a-cd316c99048b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.247216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 916/1813] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:19 2022] GET /identity/v3/roles => generated 1420 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:20.247712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.248355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.248637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.248935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.251922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.254904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.261009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.293213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:20.306193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5df8f44-c160-4814-a9c0-2c6362ec78b9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.326381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 898/1814] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:19 2022] POST /identity/v3/users => generated 291 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:20.327409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.355308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.356879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.359103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0511f7f0-7996-4ee3-b094-aafe2feacc12 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.366509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.367039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] PATH_INFO: `/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e/users/ed7769a7784640e2a0307a3f782a4817/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.381544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.382174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.382456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.382839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.383505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.387081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.419859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 899/1815] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:20.421124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.444872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a476aa9e27674c9a84d0f57c582a3f7e, user_id=ed7769a7784640e2a0307a3f782a4817, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.447144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db689ed1-570d-4998-b37b-870833ae1a6b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.459476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.472077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.472955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.473262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.473541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] PATH_INFO: `/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7/users/3d2d7274a8774b329975061e1ff8f3f0/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.521906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 917/1816] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:20 2022] PUT /identity/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e/users/ed7769a7784640e2a0307a3f782a4817/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:20.530119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.552180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1779dd1eb6e4238a1114ca7b0367ac7, user_id=3d2d7274a8774b329975061e1ff8f3f0, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.568074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.624885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 900/1817] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:20 2022] PUT /identity/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7/users/3d2d7274a8774b329975061e1ff8f3f0/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:20.646518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.694425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabf38fe-82c7-41a6-86be-43af2f8ffc5c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.731979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:20.866552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee352daa-a549-4c7d-9e9c-d5feab8e1d7b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.883288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.883991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.884312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.884647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.886779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:20.887410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:20.888223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:20.888223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:20.888651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.889034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:20.897746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.899319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:20.964147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 901/1818] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:20.964147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.964426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 918/1819] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:20 2022] GET /identity/v3/roles => generated 1420 bytes in 438 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:20.966182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:20.987389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb8f0b6-1f7e-4f90-adb8-c81015212956 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:20.988188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5bc74a-8a0c-44e3-9a39-37255ea11740 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:21.002412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:21.003256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.004380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:21.004615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.004886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.005244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] PATH_INFO: `/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7/users/3d2d7274a8774b329975061e1ff8f3f0/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.005556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.006827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] PATH_INFO: `/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e/users/ed7769a7784640e2a0307a3f782a4817/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.010254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1779dd1eb6e4238a1114ca7b0367ac7, user_id=3d2d7274a8774b329975061e1ff8f3f0, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:21.011047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] RBAC: Authorizing `identity:create_grant(project_id=a476aa9e27674c9a84d0f57c582a3f7e, user_id=ed7769a7784640e2a0307a3f782a4817, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:21.015835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c44c008-7bd4-476e-882a-40f66a3e666a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:21.018121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe07b5dc-3014-4cbf-9df0-54d028eb19da admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:21.043542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 902/1820] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:20 2022] PUT /identity/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e/users/ed7769a7784640e2a0307a3f782a4817/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:21.043866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 919/1821] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:20 2022] PUT /identity/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7/users/3d2d7274a8774b329975061e1ff8f3f0/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:21.053940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.056200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.056699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.057319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.058793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.073414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.182195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] MFA Rules not processed for user `ed7769a7784640e2a0307a3f782a4817`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:21.183982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:21.189589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] MFA Rules not processed for user `3d2d7274a8774b329975061e1ff8f3f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:21.195501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:21.373984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 903/1822] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:21.383720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:21.386128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:21.440311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 920/1823] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:21 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:21.450235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:21.452486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:21.475561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:21.558571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f9f503-c72d-4875-9a58-dacdadf3bdc6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:21.562787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:21.564558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.566568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.566964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.581345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:21.583553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:21.584070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af84b375-4d4c-4f3a-ae6c-311cd941cfd2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:21.600530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:21.601340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:21.601685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:21.602185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:21.615787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 921/1824] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:21 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:21.821690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:21.823335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:21.859691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 904/1825] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 476 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:22.131802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:22.132569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:22.252329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:22.349943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd56bb-a3f2-4efd-b35b-2c270eaa7496 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:22.357085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:22.358339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:22.358864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:22.359393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] PATH_INFO: `/v3/projects/0e23427bc66e4694a6d3d47dfe20596e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:22.361899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e23427bc66e4694a6d3d47dfe20596e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:22.367206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:22.511669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e23427bc66e4694a6d3d47dfe20596e', 'request_id': 'req-c53b198b-18e4-4d67-b29e-01b00b1db92b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:22.530523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e23427bc66e4694a6d3d47dfe20596e', 'request_id': 'req-c53b198b-18e4-4d67-b29e-01b00b1db92b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:22.539055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e23427bc66e4694a6d3d47dfe20596e', 'request_id': 'req-c53b198b-18e4-4d67-b29e-01b00b1db92b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:22.595182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] The token cache is being invalidate because project 0e23427bc66e4694a6d3d47dfe20596e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:22.595819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:22.598047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c53b198b-18e4-4d67-b29e-01b00b1db92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:22.602463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 922/1826] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:22 2022] DELETE /identity/v3/projects/0e23427bc66e4694a6d3d47dfe20596e => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:22.608117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:22.635013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d8a46-a849-4c1a-95ea-a9901a755125 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:22.652240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee8ee-f12c-4861-b687-c3e0884abed4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:22.652530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee8ee-f12c-4861-b687-c3e0884abed4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:22.652791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ee8ee-f12c-4861-b687-c3e0884abed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:22.734202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-506ee8ee-f12c-4861-b687-c3e0884abed4 None None] MFA Rules not processed for user `386e1605489846248e898a62c79643fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:22.741502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-506ee8ee-f12c-4861-b687-c3e0884abed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:22.944919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:22.946702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:22.947400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:22.950656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] PATH_INFO: `/v3/users/c2b7bbe2d0474417b1d2cc0f3615544a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:22.967004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c2b7bbe2d0474417b1d2cc0f3615544a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:22.986910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:23.084029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 923/1827] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:22 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:23.195192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c2b7bbe2d0474417b1d2cc0f3615544a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:23.208932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c2b7bbe2d0474417b1d2cc0f3615544a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:23.233555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c2b7bbe2d0474417b1d2cc0f3615544a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:23.235330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c2b7bbe2d0474417b1d2cc0f3615544a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:23.250861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c2b7bbe2d0474417b1d2cc0f3615544a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:23.254303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:23.266743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 905/1828] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:22 2022] DELETE /identity/v3/users/c2b7bbe2d0474417b1d2cc0f3615544a => generated 0 bytes in 660 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:23.801760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:23.803218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bfff-54cc-4d47-aada-b44bf52a3756 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:23.805094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bfff-54cc-4d47-aada-b44bf52a3756 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:23.805551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8bfff-54cc-4d47-aada-b44bf52a3756 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:23.805922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:23.809917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 924/1829] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:10:23 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:10:23.919186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:23.919714 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:23.920836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:24.006126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:24.007709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:24.040274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9c472c-edd3-4527-b61f-449776adbee1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:24.064972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:24.069659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:24.069998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:24.070284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] PATH_INFO: `/v3/projects/68fba9ef2c6742eda0594112794ba466` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:24.077464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68fba9ef2c6742eda0594112794ba466)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:24.089703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:24.188989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:24.258745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 925/1830] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:10:23 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:24.312827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68fba9ef2c6742eda0594112794ba466', 'request_id': 'req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.340181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68fba9ef2c6742eda0594112794ba466', 'request_id': 'req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.364077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68fba9ef2c6742eda0594112794ba466', 'request_id': 'req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.414974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] The token cache is being invalidate because project 68fba9ef2c6742eda0594112794ba466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:24.414974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.418167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.424523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 906/1831] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:23 2022] DELETE /identity/v3/projects/68fba9ef2c6742eda0594112794ba466 => generated 0 bytes in 621 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:24.426556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:24.442975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e5dd7-72f9-4237-8a75-3b33b1403e72 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:24.619797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:24.621097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:24.622465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:24.622990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] PATH_INFO: `/v3/users/2f8925d0d7b047348533a15f081c4cb5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:24.639687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f8925d0d7b047348533a15f081c4cb5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:24.651188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:24.831791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f8925d0d7b047348533a15f081c4cb5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.857663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f8925d0d7b047348533a15f081c4cb5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.878205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f8925d0d7b047348533a15f081c4cb5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.878850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f8925d0d7b047348533a15f081c4cb5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.914248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f8925d0d7b047348533a15f081c4cb5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:24.928127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 926/1832] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:24 2022] DELETE /identity/v3/users/2f8925d0d7b047348533a15f081c4cb5 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:25.639244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:25.643683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:25.766919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:25.767923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:25.935643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c55ed7-3ff1-4534-8a3e-b72edcebd335 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:25.991417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad67bf8d-ae7c-430e-a0df-47ea3cd6e83c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:25.999114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:26.001062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:26.001620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:26.002104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] PATH_INFO: `/v3/users/1b7a52256a54483da4b3fda79fa04c83` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:26.007186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b7a52256a54483da4b3fda79fa04c83)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:26.021058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:26.033601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:26.058159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:26.154658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b7a52256a54483da4b3fda79fa04c83'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.162037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:26.162771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:26.163061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:26.163383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:26.168381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.170522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b7a52256a54483da4b3fda79fa04c83'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.196009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b7a52256a54483da4b3fda79fa04c83'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.200088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b7a52256a54483da4b3fda79fa04c83'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.241578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b7a52256a54483da4b3fda79fa04c83'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.261951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:26.268979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb524cd6-7aec-4e40-90a5-c3f0cbcd0b0f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:26.276354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 927/1833] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:25 2022] DELETE /identity/v3/users/1b7a52256a54483da4b3fda79fa04c83 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:26.285085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:26.292134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.325342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 907/1834] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:26.331009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:26.331372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:26.334469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:26.409351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:26.410654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.555927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22439d7-27cd-4e7d-973f-0fa34c40ed5e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:26.562562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:26.564402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:26.564891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:26.565395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:26.570502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.669897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 908/1835] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 344 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:26.723919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:26.725740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:26.740562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:26.741406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 928/1836] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:26.751476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.767505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350817cc-fe01-4de7-8fff-4b874ea01621 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:26.774477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:26.775486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:26.775877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:26.776246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] PATH_INFO: `/v3/projects/b4ad88f4272d416988faee6ad8357c01` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:26.777759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4ad88f4272d416988faee6ad8357c01)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:26.780077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:26.809139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:26.811080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:26.915764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4ad88f4272d416988faee6ad8357c01', 'request_id': 'req-367ad6ef-1699-412e-b041-48a1877e1a15'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.939671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4ad88f4272d416988faee6ad8357c01', 'request_id': 'req-367ad6ef-1699-412e-b041-48a1877e1a15'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:26.955238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:26.977309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4ad88f4272d416988faee6ad8357c01', 'request_id': 'req-367ad6ef-1699-412e-b041-48a1877e1a15'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:27.001320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b21d3c9-7164-4311-a945-4b6d88eec5fc service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:27.008350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] The token cache is being invalidate because project b4ad88f4272d416988faee6ad8357c01 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:27.009000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:27.012369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-367ad6ef-1699-412e-b041-48a1877e1a15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:27.018721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 909/1837] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:26 2022] DELETE /identity/v3/projects/b4ad88f4272d416988faee6ad8357c01 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:27.023878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:27.024742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:27.025357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:27.086472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:27.090152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:27.140745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:27.141758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:27.142192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:27.142638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:27.147935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:27.252921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:27.306730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:27.308271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b64e089-803e-434e-b83f-26bc8aa6bd4b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:27.331017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 929/1838] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:27.374304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 910/1839] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:27.380409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:27.380697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:27.380981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:27.446651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:27.448566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:27.484103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 930/1840] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:27.490721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:27.530313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30c73cf-6d26-40d2-8440-c806584194ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:27.564137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:27.565023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:27.565334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:27.565864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:27.566508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:27.566830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:27.570821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:27.645044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 911/1841] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:27.646206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:27.657755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf68d6b2-c42f-44f2-a166-dce2a3576d6b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:27.674566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:27.675575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:27.676071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:27.676580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:27.677628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:27.679784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:27.739761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 931/1842] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:27 2022] POST /identity/v3/projects => generated 401 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:27.744073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:27.761049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4069c5cf-9579-47e6-bc7e-04d1fdd86803 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:28.011085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:28.012358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.014112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.015057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.016219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:28.022603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:28.057518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 912/1843] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:27 2022] POST /identity/v3/users => generated 301 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:28.062687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:28.074866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa9a193-d7f2-4573-ba6b-1c6edef72e8d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:28.119549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:28.128582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.128939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.129957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.130226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:28.132227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:28.157988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 932/1844] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:28.162803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:28.211855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70252ea2-0cf0-47f3-8c6c-30e3a637ce29 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:28.226043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:28.227649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.227934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.228216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.231021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:28.235829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:28.268332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 913/1845] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:28 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:28.287044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:28.305929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959e5d6e-dcbc-49c2-b899-17ce64896eb0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:28.306571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:28.316275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:28.324323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:28.326756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.329418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.329932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] PATH_INFO: `/v3/projects/44ea19b354fa48549fd947b6d44b573e/users/83cec71c51874c6d826b4f4ed5da0580/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.367401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8a6bb8-d98d-4037-a3b8-e311e31fda08 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:28.374076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44ea19b354fa48549fd947b6d44b573e, user_id=83cec71c51874c6d826b4f4ed5da0580, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:28.384923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50257077-32d1-4e58-bf79-0ef9188455c6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:28.401275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:28.407183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.407183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.407183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] PATH_INFO: `/v3/projects/1160b193e50d4127acebd3b4a3d6171e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.410132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=1160b193e50d4127acebd3b4a3d6171e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:28.413353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 933/1846] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:28 2022] PUT /identity/v3/projects/44ea19b354fa48549fd947b6d44b573e/users/83cec71c51874c6d826b4f4ed5da0580/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:28.414637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:28.427367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.429567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.429860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.492511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] MFA Rules not processed for user `83cec71c51874c6d826b4f4ed5da0580`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:28.506091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:28.584173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1160b193e50d4127acebd3b4a3d6171e', 'request_id': 'req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:28.598536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1160b193e50d4127acebd3b4a3d6171e', 'request_id': 'req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:28.608445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1160b193e50d4127acebd3b4a3d6171e', 'request_id': 'req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:28.615270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:28.661858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] The token cache is being invalidate because project 1160b193e50d4127acebd3b4a3d6171e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:28.662163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:28.663238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d4e3fafa-5fe3-4f34-9fb1-87b12a4c38ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:28.667901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 914/1847] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:28 2022] DELETE /identity/v3/projects/1160b193e50d4127acebd3b4a3d6171e => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:28.670652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687071-b276-4b6a-8483-a84ff5858977 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.670945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687071-b276-4b6a-8483-a84ff5858977 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.671230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f687071-b276-4b6a-8483-a84ff5858977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.726682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5f687071-b276-4b6a-8483-a84ff5858977 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:28.732767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f687071-b276-4b6a-8483-a84ff5858977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:28.759836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:28.775270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 934/1848] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:28 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:28.780815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:28.786347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:28.899257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 915/1849] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:28.908679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:28.908982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:28.909272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:28.941968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:28.947861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:28.961798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 916/1850] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:28.971599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.053642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badd026c-f07b-40cb-b63b-e9a39ed5d9f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.070437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.071792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6d36bb-7649-49ee-86fa-c327f485d6fd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.077779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.078104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.080896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.081905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:29.082221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.089976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a43867-d54a-478b-8962-4e5e43eb4180 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.105988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.106738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.107121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.110385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.111424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.114460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.161337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 917/1851] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:29.163097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.163967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.164892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.242433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 935/1852] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:28 2022] POST /identity/v3/projects => generated 399 bytes in 462 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:29.243341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.251854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.259151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] MFA Rules not processed for user `6efb292e19dc445b9b01e455fa2befec`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:29.260380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.381934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b184ff1-d4c0-4883-95da-65cd67231fb1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.393868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 918/1853] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:29.394876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.395558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.396342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.396342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] PATH_INFO: `/v3/projects/b930382969244a24a7a6d5f23fc8b983` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.396884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.397409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b930382969244a24a7a6d5f23fc8b983)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.399335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.411555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12d159b-04eb-45a2-a704-e90a347f5e63 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.418581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.419927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.420432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.420921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.421836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.424844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.464563 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 919/1854] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:29 2022] POST /identity/v3/projects => generated 381 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:29.465644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.469691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b930382969244a24a7a6d5f23fc8b983', 'request_id': 'req-331ff402-4085-4095-8d9f-28b00fc123c4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.480473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b930382969244a24a7a6d5f23fc8b983', 'request_id': 'req-331ff402-4085-4095-8d9f-28b00fc123c4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.488128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:29.490992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b930382969244a24a7a6d5f23fc8b983', 'request_id': 'req-331ff402-4085-4095-8d9f-28b00fc123c4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.515252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] The token cache is being invalidate because project b930382969244a24a7a6d5f23fc8b983 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:29.515468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.516335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.518918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 936/1855] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:29 2022] DELETE /identity/v3/projects/b930382969244a24a7a6d5f23fc8b983 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:29.520347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.521862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.543519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128707b4-4761-4fee-b53d-04586686e844 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.554610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.555636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.555922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.556266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.557126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.559096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.591997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 920/1856] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:29 2022] POST /identity/v3/users => generated 306 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:29.595130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.595361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.608199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906804c3-d191-46cf-bc7c-38f5ba3c4c35 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.614498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.615521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.615521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.615876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] PATH_INFO: `/v3/users/3d2d7274a8774b329975061e1ff8f3f0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.617383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d2d7274a8774b329975061e1ff8f3f0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.619687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.647256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331ff402-4085-4095-8d9f-28b00fc123c4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.648377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:29.659849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.660491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.660769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.661038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.661948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.665113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.697721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 937/1857] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:29 2022] POST /identity/v3/users => generated 291 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:29.698641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.700428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.716382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f69ef0d-b915-4b50-a35e-a56866ddbd6d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.720957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d2d7274a8774b329975061e1ff8f3f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.721333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.722207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.722499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.722770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.723427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.724999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.738487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d2d7274a8774b329975061e1ff8f3f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.755102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 938/1858] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:29.759767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.767460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d2d7274a8774b329975061e1ff8f3f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.769455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d2d7274a8774b329975061e1ff8f3f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.774135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2228a665-84f9-4354-ad30-952991d333ed admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.780201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.780399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.780811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.781088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.782086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.782589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d2d7274a8774b329975061e1ff8f3f0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:29.783861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.791708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 921/1859] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:29 2022] DELETE /identity/v3/users/3d2d7274a8774b329975061e1ff8f3f0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:29.793139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.795757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.796264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 939/1860] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:29.801252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.804136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:29.822404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4fedb2-243a-4a09-8943-e85ed579f395 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.901104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e36298-48ac-4ccb-855b-2bff4133d4fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.906983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.907765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.908456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.908456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] PATH_INFO: `/v3/projects/418440488e5b4360bb179331ae825b8b/users/026b4a0793774431bae76c7d1e0377c9/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.925045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:29.925802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:29.926197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:29.926810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:29.927593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.929059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418440488e5b4360bb179331ae825b8b, user_id=026b4a0793774431bae76c7d1e0377c9, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:29.929347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.936597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:29.946362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 940/1861] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:29.954441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:29.965648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56e970d-ac5f-4f28-8dde-bae5278b9cfc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:29.969624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 922/1862] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:29 2022] PUT /identity/v3/projects/418440488e5b4360bb179331ae825b8b/users/026b4a0793774431bae76c7d1e0377c9/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:29.974539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.032708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:30.046447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b062fe-2d1c-4d13-b31b-ce28bd4d5ca5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.046711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.048534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.048665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.048899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] PATH_INFO: `/v3/projects/8ddf2aede85f43158c7f5e5ddbe5c5f9/users/4b64b6166504481b97ae50187f5f7bde/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.052953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.053695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.054033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.054372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.055093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.056690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.069340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8ddf2aede85f43158c7f5e5ddbe5c5f9, user_id=4b64b6166504481b97ae50187f5f7bde, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.071547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 923/1863] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:29 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:30.072649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973af9f7-592b-4813-9bf3-6b4a22904163 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.075687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.090819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c2b854-78d6-4ad7-ae22-cf536e528d96 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.103860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 941/1864] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:29 2022] PUT /identity/v3/projects/8ddf2aede85f43158c7f5e5ddbe5c5f9/users/4b64b6166504481b97ae50187f5f7bde/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:30.104684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:30.115160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.115448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.115737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.161713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.162299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.162582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.163078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] PATH_INFO: `/v3/projects/418440488e5b4360bb179331ae825b8b/users/026b4a0793774431bae76c7d1e0377c9/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.165828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] RBAC: Authorizing `identity:create_grant(project_id=418440488e5b4360bb179331ae825b8b, user_id=026b4a0793774431bae76c7d1e0377c9, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.168615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72e8aa5-afda-4d20-88cd-d7c372be2226 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.171792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] MFA Rules not processed for user `4b64b6166504481b97ae50187f5f7bde`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:30.182011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.182510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 924/1865] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:30 2022] PUT /identity/v3/projects/418440488e5b4360bb179331ae825b8b/users/026b4a0793774431bae76c7d1e0377c9/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:30.194791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.195017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.195373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.238540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] MFA Rules not processed for user `026b4a0793774431bae76c7d1e0377c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:30.240347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.305643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 942/1866] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:30.306624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.308067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.381119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 925/1867] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:30.383454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.508449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf7bfbe-2425-4ebd-a704-89e8c6064650 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.527076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.527735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.528015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.528289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] PATH_INFO: `/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.531470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1779dd1eb6e4238a1114ca7b0367ac7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.534860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.541603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3d65fb-aa07-4329-bd71-c924ca7ecbc5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.556068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.556764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.557052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.557382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.558095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.560230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.605157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 926/1868] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/projects => generated 381 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:30.605157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.607128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.615487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1779dd1eb6e4238a1114ca7b0367ac7', 'request_id': 'req-2025a123-45e4-407e-8e13-ee26b6d1c89e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:30.634193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1779dd1eb6e4238a1114ca7b0367ac7', 'request_id': 'req-2025a123-45e4-407e-8e13-ee26b6d1c89e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:30.652225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1779dd1eb6e4238a1114ca7b0367ac7', 'request_id': 'req-2025a123-45e4-407e-8e13-ee26b6d1c89e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:30.656946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:30.657583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:30.682845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] The token cache is being invalidate because project d1779dd1eb6e4238a1114ca7b0367ac7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:30.683392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:30.684124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:30.688435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 943/1869] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:30 2022] DELETE /identity/v3/projects/d1779dd1eb6e4238a1114ca7b0367ac7 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:30.690679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.692428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.725888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f127603-eb36-4cd5-9d78-621556bfe612 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.732732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.733594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.733876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.735107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.737311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.810348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025a123-45e4-407e-8e13-ee26b6d1c89e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.827666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.829364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aadf2a-5c59-499d-909a-05dbed577fbd service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.852801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 927/1870] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:30.856855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02037c8-f556-4458-b7b0-df9597e98666 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.857943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02037c8-f556-4458-b7b0-df9597e98666 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.858783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02037c8-f556-4458-b7b0-df9597e98666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.885821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.886446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.887155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.887574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.888218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.890703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.893933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c02037c8-f556-4458-b7b0-df9597e98666 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:30.895570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c02037c8-f556-4458-b7b0-df9597e98666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.908207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 928/1871] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:30.917363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 944/1872] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/users => generated 297 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:30.917590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.917879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.918160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.920668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.936808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78777288-e4d7-4917-b96e-cb971d53526a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.943601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.943817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:30.944679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.944968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:30.945083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.945435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.946188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.948010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:30.959935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 945/1873] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:30 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:30.961941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 929/1874] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:30.964306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.976662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:30.977119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a432a1c-9345-456d-829f-6df2ebf4ecea admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.982617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.983351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.983811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.984024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] PATH_INFO: `/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61/users/a080985c752a4114b2d6360527c8ffb6/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.988356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72d5833-7fbc-47f4-8373-63b64f8b6b78 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:30.993733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:30.994353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:30.994634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:30.994924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:30.995602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:30.995910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:30.997613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.001675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e68e9c5da4c4d1d8aa1060293558d61, user_id=a080985c752a4114b2d6360527c8ffb6, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.004347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.010534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 930/1875] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:31.010534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.010534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:31.025635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 946/1876] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:30 2022] PUT /identity/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61/users/a080985c752a4114b2d6360527c8ffb6/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:31.025635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.026438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb55b3-6dfe-4363-90cf-69a4b518be9c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.077662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.078840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.079149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.079423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.081275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:31.088251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:31.092347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc6cb78-86d2-45d0-802b-bc2f431c7dda admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.099511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.100117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.100400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.100673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.101335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.103247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.134992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 947/1877] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:31 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:31.134992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.142776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:31.146967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.148917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.159120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 931/1878] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:31.159899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.171325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6e22c2-7ae0-4eeb-a3a7-3fcb5eec8805 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.199845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad423e-f4af-4544-ba52-54c66331236c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.206633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.207240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.207526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.207802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.208574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.210238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.226592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 948/1879] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:31.229247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.238107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.239017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.239296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.239666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.240642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.241076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678475cc-871b-438d-a9fb-62751a1233b1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.242898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb000d02-d8ad-44f7-b765-94a6702251d8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.247563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.248335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.248795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.249143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] PATH_INFO: `/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61/users/a080985c752a4114b2d6360527c8ffb6/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.251591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e68e9c5da4c4d1d8aa1060293558d61, user_id=a080985c752a4114b2d6360527c8ffb6, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.254305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.269448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 949/1880] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:31 2022] PUT /identity/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61/users/a080985c752a4114b2d6360527c8ffb6/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:31.272052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 932/1881] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:31 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:31.275965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.282975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.283651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.283939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.316196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] MFA Rules not processed for user `a080985c752a4114b2d6360527c8ffb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:31.317468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:31.358770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4054f5d5-89c6-4bc7-a6a2-3fcdaea4f261 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.363989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.364771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.365163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.367476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.367476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.367920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.381248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 950/1882] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:31.386934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.404725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f04ab93-b42c-401f-b3dc-651703836c67 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.408298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 933/1883] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:31 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:31.411428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.414118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.415137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.415137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.416878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.419670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.432929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.435081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:31.439481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 951/1884] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:31.458897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.479753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8874cd5b-63a9-496e-932d-ac0bdc1738ad admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.485139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.486171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.486559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.486994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] PATH_INFO: `/v3/projects/91107543441a46afbcba58c71695db35/users/201a469a65b542929b9d4daf14898d28/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.510180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91107543441a46afbcba58c71695db35, user_id=201a469a65b542929b9d4daf14898d28, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.514592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37348bc5-36d3-4f17-95c7-e29314618528 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.541210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 952/1885] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:31 2022] PUT /identity/v3/projects/91107543441a46afbcba58c71695db35/users/201a469a65b542929b9d4daf14898d28/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:31.559210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.559513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.560239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.626527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] MFA Rules not processed for user `201a469a65b542929b9d4daf14898d28`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:31.627754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:31.634929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10c737a-865d-42af-a990-51c6c9e31a02 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.674558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:31.680664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:31.736571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.737278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.737540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.737847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.754781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 953/1886] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:31.800667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:31.811384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fefc4da-8104-4a3f-b030-61e1a060099d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:31.815159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:31.815776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:31.816126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:31.816390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:31.818616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.820972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.828962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:31.830463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84910d2-8851-40b4-987e-3b2561c84b5e service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:31.831703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 934/1887] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:31.843454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 954/1888] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:31 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:32.132803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:32.143370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ed03ae-a286-4be2-92bb-a7b5758a72ca service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:32.147658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:32.148271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:32.148547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:32.148819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:32.153388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:32.261203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:32.263474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:32.285551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 935/1889] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:32 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:35.035083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:35.035954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fb6ed-db99-4f79-a70b-6fd5dc9e6851 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.035954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fb6ed-db99-4f79-a70b-6fd5dc9e6851 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.036441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1fb6ed-db99-4f79-a70b-6fd5dc9e6851 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.037622 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 955/1890] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:10:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:10:35.065819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.066106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.066467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.103576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:35.104981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:35.187671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace1f999-bbf9-464a-9824-eee6c39123e3 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:35.200696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:35.201384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.201664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.201941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] PATH_INFO: `/v3/users/4b64b6166504481b97ae50187f5f7bde` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.205281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b64b6166504481b97ae50187f5f7bde)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:35.213458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:35.232546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:35.271105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 956/1891] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:10:35 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:35.298344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:35.300712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:35.315436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b64b6166504481b97ae50187f5f7bde'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:35.329720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdad877-2e88-4344-9d41-a1b1cdf832db None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:35.333963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b64b6166504481b97ae50187f5f7bde'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:35.342919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:35.344634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.348410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.348713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.363873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:35.366207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55655c12-f187-4b05-9acc-cd552d7b16f6 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:35.377698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b64b6166504481b97ae50187f5f7bde'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:35.379541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b64b6166504481b97ae50187f5f7bde'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:35.381797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 957/1892] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:35 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:35.399034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b64b6166504481b97ae50187f5f7bde'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:35.438105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 936/1893] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:35 2022] DELETE /identity/v3/users/4b64b6166504481b97ae50187f5f7bde => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:35.442911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.444174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.444694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.506652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:35.510914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:35.668940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 958/1894] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:35.776540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:35.778995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:35.903618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada190f-2089-4294-a961-898c014ca173 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:35.908847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:35.909386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:35.909810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:35.910192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:35.924986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:35.927739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faaeacba-a3fb-4410-aa67-49df1f6abd7f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:35.959129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 937/1895] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:36.298108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:36.300778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:36.318416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47a8718-eb75-4b75-934f-64f7c75ee59c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:36.324602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:36.325501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:36.326272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:36.326795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] PATH_INFO: `/v3/users/83cec71c51874c6d826b4f4ed5da0580` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:36.329269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83cec71c51874c6d826b4f4ed5da0580)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:36.331993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:36.352628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:36.440902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83cec71c51874c6d826b4f4ed5da0580'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:36.457026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83cec71c51874c6d826b4f4ed5da0580'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:36.468021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83cec71c51874c6d826b4f4ed5da0580'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:36.468874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83cec71c51874c6d826b4f4ed5da0580'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:36.498432 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83cec71c51874c6d826b4f4ed5da0580'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:36.511791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 959/1896] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:36 2022] DELETE /identity/v3/users/83cec71c51874c6d826b4f4ed5da0580 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:36.516099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:36.516814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:36.516814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:36.551128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:36.553035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:36.676294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 938/1897] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:36.685671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:36.687657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:36.748596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0830d4e-fded-43a1-8592-e717db883200 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:36.752881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:36.753525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:36.753805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:36.754077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:36.763796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:36.765329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:36.775493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 960/1898] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:36.884672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:36.886111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:36.904240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c7931b-e6ef-4436-a7e8-114e1225c25d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:36.926473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:36.928214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:36.929601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:36.930210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] PATH_INFO: `/v3/projects/8ddf2aede85f43158c7f5e5ddbe5c5f9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:36.937826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8ddf2aede85f43158c7f5e5ddbe5c5f9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:36.938117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:37.001176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:37.038541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8ddf2aede85f43158c7f5e5ddbe5c5f9', 'request_id': 'req-dcf7e25f-d9a6-4027-b64e-117abcd7c516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.048167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8ddf2aede85f43158c7f5e5ddbe5c5f9', 'request_id': 'req-dcf7e25f-d9a6-4027-b64e-117abcd7c516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.055540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8ddf2aede85f43158c7f5e5ddbe5c5f9', 'request_id': 'req-dcf7e25f-d9a6-4027-b64e-117abcd7c516'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.076884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] The token cache is being invalidate because project 8ddf2aede85f43158c7f5e5ddbe5c5f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:37.077383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.079448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.085512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 939/1899] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:36 2022] DELETE /identity/v3/projects/8ddf2aede85f43158c7f5e5ddbe5c5f9 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:37.085999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:37.115341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fa56ba-0c83-41ba-ac3c-1d680868f0ad service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:37.202665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:37.205477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:37.205911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:37.206578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:37.206866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:37.207151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] PATH_INFO: `/v3/users/a080985c752a4114b2d6360527c8ffb6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:37.213353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a080985c752a4114b2d6360527c8ffb6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:37.215349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:37.242858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf7e25f-d9a6-4027-b64e-117abcd7c516 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:37.256118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:37.256777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:37.257062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:37.257367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] PATH_INFO: `/v3/projects/44ea19b354fa48549fd947b6d44b573e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:37.259544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] RBAC: Authorizing `identity:delete_project(project_id=44ea19b354fa48549fd947b6d44b573e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:37.263891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:37.303499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:37.328377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a080985c752a4114b2d6360527c8ffb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.340920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a080985c752a4114b2d6360527c8ffb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.347825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44ea19b354fa48549fd947b6d44b573e', 'request_id': 'req-b9ced19e-66b8-494b-85e7-7843199e867b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.357709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a080985c752a4114b2d6360527c8ffb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.359314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44ea19b354fa48549fd947b6d44b573e', 'request_id': 'req-b9ced19e-66b8-494b-85e7-7843199e867b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.360175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a080985c752a4114b2d6360527c8ffb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.371696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44ea19b354fa48549fd947b6d44b573e', 'request_id': 'req-b9ced19e-66b8-494b-85e7-7843199e867b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.386192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a080985c752a4114b2d6360527c8ffb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.393919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] The token cache is being invalidate because project 44ea19b354fa48549fd947b6d44b573e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:37.394350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.395107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.396990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 940/1900] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:37 2022] DELETE /identity/v3/projects/44ea19b354fa48549fd947b6d44b573e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:37.400490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 961/1901] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:37 2022] DELETE /identity/v3/users/a080985c752a4114b2d6360527c8ffb6 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:37.401215 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:37.403328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:37.516172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ced19e-66b8-494b-85e7-7843199e867b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:37.569425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:37.595871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:37.596579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:37.597127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:37.597436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] PATH_INFO: `/v3/users/026b4a0793774431bae76c7d1e0377c9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:37.598748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] RBAC: Authorizing `identity:delete_user(user_id=026b4a0793774431bae76c7d1e0377c9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:37.600729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:37.669678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '026b4a0793774431bae76c7d1e0377c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.689755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '026b4a0793774431bae76c7d1e0377c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.735004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:37.736587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:37.746613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '026b4a0793774431bae76c7d1e0377c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.747438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '026b4a0793774431bae76c7d1e0377c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.757934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-588b4598-1435-4196-9745-2da538aa8581 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '026b4a0793774431bae76c7d1e0377c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.762355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd3c9d2-f01b-42d0-91df-ef8e6e4d8244 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:37.765952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 941/1902] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:37 2022] DELETE /identity/v3/users/026b4a0793774431bae76c7d1e0377c9 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:37.769117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:37.770223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:37.770901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:37.771303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] PATH_INFO: `/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:37.772760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e68e9c5da4c4d1d8aa1060293558d61)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:37.775168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:37.850740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e68e9c5da4c4d1d8aa1060293558d61', 'request_id': 'req-bb15ba32-3a4a-4f7c-a0fc-996463345b28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.864924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e68e9c5da4c4d1d8aa1060293558d61', 'request_id': 'req-bb15ba32-3a4a-4f7c-a0fc-996463345b28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.873035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e68e9c5da4c4d1d8aa1060293558d61', 'request_id': 'req-bb15ba32-3a4a-4f7c-a0fc-996463345b28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.893300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] The token cache is being invalidate because project 7e68e9c5da4c4d1d8aa1060293558d61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:37.893521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.894238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bb15ba32-3a4a-4f7c-a0fc-996463345b28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:37.897039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 962/1903] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:37 2022] DELETE /identity/v3/projects/7e68e9c5da4c4d1d8aa1060293558d61 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:37.902250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:37.903685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:37.904093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:37.941576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:37.954314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.072433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.073049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.073545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.079572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 942/1904] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:38.100299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:38.102824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.119974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.127813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 963/1905] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:38.135005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb6dc78-b41b-4a7c-8080-6b8d9c702e09 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.143951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.144981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.145491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.146473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.147390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:38.147864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.150299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.172373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.178370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 943/1906] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:38.185143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c616ff2-a946-4deb-80ba-c48075e5e37d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.193093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.194368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.194710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.195179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.196098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.198331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.228064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.230295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.257577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 964/1907] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:38.261903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.272848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546f0d0c-d42f-43fd-9c40-458b5b59cfb4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.384721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:38.394915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.395827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.396167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.396518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] PATH_INFO: `/v3/projects/418440488e5b4360bb179331ae825b8b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.397608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ce0362-7720-4fa2-ae58-e58f5ec381b3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.398166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] RBAC: Authorizing `identity:delete_project(project_id=418440488e5b4360bb179331ae825b8b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.401472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.403321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.404247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.404535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.404814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.405488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.408636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.435962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=12,keystone:SELECT=82,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:38.445352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 965/1908] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:38.445352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.451395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.477276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '418440488e5b4360bb179331ae825b8b', 'request_id': 'req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.477781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7457cd-edc6-431c-957d-8115eb599f91 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.485426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '418440488e5b4360bb179331ae825b8b', 'request_id': 'req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.494335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '418440488e5b4360bb179331ae825b8b', 'request_id': 'req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.517442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] The token cache is being invalidate because project 418440488e5b4360bb179331ae825b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:38.518149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.518408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.520161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 944/1909] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:38 2022] DELETE /identity/v3/projects/418440488e5b4360bb179331ae825b8b => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:38.533814 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.535628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.561209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.562035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.563157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.563444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] PATH_INFO: `/v3/users/201a469a65b542929b9d4daf14898d28` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.564858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=201a469a65b542929b9d4daf14898d28)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.567418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.614540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b70c8a-34fa-4bbf-bf27-84f4500a7572 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.621807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.622441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.622789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.623071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.623710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.626499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b953b6-c19c-4dfa-ada6-a93d70b56d81 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.643280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 945/1910] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:38.643280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.643280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.643280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.665269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '201a469a65b542929b9d4daf14898d28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.680188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '201a469a65b542929b9d4daf14898d28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.682194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:38.683641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.702157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 946/1911] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:38.703467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '201a469a65b542929b9d4daf14898d28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.705525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.710617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '201a469a65b542929b9d4daf14898d28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.731013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468c7b28-0da3-4b2e-8ae8-d7aac4fba51f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:38.737511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-19c123e9-e763-4dd2-b74c-5ca2f08380aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '201a469a65b542929b9d4daf14898d28'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:38.742539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:38.742539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.742539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.742539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.745044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:38.745044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45a2f5-34aa-4ec4-aaa7-15acd2b12a6e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:38.755889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 966/1912] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:38 2022] DELETE /identity/v3/users/201a469a65b542929b9d4daf14898d28 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:38.760371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.760664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.760936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.770845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 947/1913] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:38 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:38.772231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:38.772526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:38.772806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:38.806224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:38.808027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.831735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:38.833660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.924616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 948/1914] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:38.925568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.926945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.967478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 967/1915] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:38.970419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:38.972536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:38.973393 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:38.992772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5119236e-91f1-43b5-95be-4735e7046413 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.003529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:39.007829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.008813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.009110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.009455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] PATH_INFO: `/v3/projects/3530ad1d7a0b4576ab40fdb87182bcc2/users/8029bc23909c422da12c794d590d75cd/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.049163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3530ad1d7a0b4576ab40fdb87182bcc2, user_id=8029bc23909c422da12c794d590d75cd, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.052799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.066110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd52a43-c0ae-4e4d-88a6-636e881faddb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.080944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 949/1916] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:38 2022] PUT /identity/v3/projects/3530ad1d7a0b4576ab40fdb87182bcc2/users/8029bc23909c422da12c794d590d75cd/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:39.084327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.147359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.148011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.148562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.148970 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.167198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6eea23-1fc2-4496-b5bd-5bda29571307 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.172383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.173993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.174284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.174639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.175415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:39.175721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.177503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a532d8a-f184-4b22-b1d1-281d420904f7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.189783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 950/1917] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:39.190856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.191137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.191410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.232114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] MFA Rules not processed for user `8029bc23909c422da12c794d590d75cd`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:39.233475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:39.242692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.244873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.263615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 968/1918] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:39.264772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.294882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3425c4c-cec9-44af-9d38-aca81f1a73c0 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.305051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.305715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.305996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.306267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.306906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.308807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.382877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 969/1919] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:39 2022] POST /identity/v3/projects => generated 409 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:39.387296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.389256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 951/1920] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:39 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:39.395576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.417346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc32454-6d03-4d74-a41b-e225e2f1701b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.526413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7770fa-9a4f-400f-b245-2ecee6157783 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.535390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.536441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.537227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.537620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.538940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.543053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.574879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:39.605150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 970/1921] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:39 2022] POST /identity/v3/users => generated 305 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:39.607562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.630663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896ddb35-cb81-4a9d-bfb7-fe501f1f9433 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.635946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.636968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.637293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.637986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.638864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.641138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.642944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.644654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.645383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.645862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.647879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.653048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.659023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 971/1922] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:39.662458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.675185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:39.681771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ade4f9-5536-45b6-b621-11c19197a75c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.702488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 952/1923] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:39 2022] POST /identity/v3/projects => generated 377 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:39.708692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.711025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.711658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.711945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.712225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.713001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.716360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.747126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 972/1924] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:39.752880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.764232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cea1273-ecf3-4695-b3a1-bf346188c1ec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.810617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301f99a-233d-415f-a85f-d3f78b057a4e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.817334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.818070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.818348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.818678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.819323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.821383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.862085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.862942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.863231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.863630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] PATH_INFO: `/v3/projects/4b5fccfdbd0b4520aa6a4511fbe2d234/users/0331e59fe4384fe9a43974b469059002/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.868072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 953/1925] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:39 2022] POST /identity/v3/users => generated 289 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:39.869435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.881937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6f926e-a5b6-4531-885e-6a322874ddbc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.884413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b5fccfdbd0b4520aa6a4511fbe2d234, user_id=0331e59fe4384fe9a43974b469059002, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.887482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.887645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.888104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.888547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.888713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.889420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.892723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.907189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 954/1926] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:39.907800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 973/1927] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:39 2022] PUT /identity/v3/projects/4b5fccfdbd0b4520aa6a4511fbe2d234/users/0331e59fe4384fe9a43974b469059002/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:39.909742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.911158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:39.918951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:39.935318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd9a9d7-58fd-4df8-b18a-9b9c67f70cee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.990316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c85c6d-9c97-4b78-b138-f952201cefa0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:39.994894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.995496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.995778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.996050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:39.996685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:39.997127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:39.997832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:39.998108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:39.998300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b30d1d0-7aca-4b94-a755-92500a4ef288 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:39.998395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] PATH_INFO: `/v3/projects/91107543441a46afbcba58c71695db35` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.000247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91107543441a46afbcba58c71695db35)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.002213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.008866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 974/1928] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:39 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:40.010303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8edf-49ce-41af-8377-d781e0c9dde7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.010589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8edf-49ce-41af-8377-d781e0c9dde7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.010860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc8edf-49ce-41af-8377-d781e0c9dde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.048787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3ecc8edf-49ce-41af-8377-d781e0c9dde7 None None] MFA Rules not processed for user `0331e59fe4384fe9a43974b469059002`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:40.050559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ecc8edf-49ce-41af-8377-d781e0c9dde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.083214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91107543441a46afbcba58c71695db35', 'request_id': 'req-21968b5d-7dfb-429f-a0c7-332d17103b14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:40.092752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91107543441a46afbcba58c71695db35', 'request_id': 'req-21968b5d-7dfb-429f-a0c7-332d17103b14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:40.099719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91107543441a46afbcba58c71695db35', 'request_id': 'req-21968b5d-7dfb-429f-a0c7-332d17103b14'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:40.114398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.119135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] The token cache is being invalidate because project 91107543441a46afbcba58c71695db35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:40.119634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:40.120554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:40.122607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.123841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 955/1929] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:39 2022] DELETE /identity/v3/projects/91107543441a46afbcba58c71695db35 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:40.126950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.129613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.163471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 975/1930] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:40.164808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.165163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.165697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.192011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:40.193480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.202343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 976/1931] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:40.203230 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.204666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.206894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21968b5d-7dfb-429f-a0c7-332d17103b14 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.214135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.214817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.215126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.215402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] PATH_INFO: `/v3/projects/341ca38e20374ed8bfda89e0c1e9f9ed/users/d9eb1b9e0f5a49528b8f8f215cf1cb4a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.216711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe17823-e6ff-406b-957d-62862b5ae13f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.223139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.224179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.224750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.225358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.226518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.228496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d089fdb-1507-42b1-8c35-d5cfcbfb5beb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.237234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] RBAC: Authorizing `identity:create_grant(project_id=341ca38e20374ed8bfda89e0c1e9f9ed, user_id=d9eb1b9e0f5a49528b8f8f215cf1cb4a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.238207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aeb3f51-1635-4471-9c73-a03be2c63050 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.258294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 956/1932] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:40 2022] PUT /identity/v3/projects/341ca38e20374ed8bfda89e0c1e9f9ed/users/d9eb1b9e0f5a49528b8f8f215cf1cb4a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:40.258825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 977/1933] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/projects => generated 409 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.259524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.259870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.260208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.269837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.270124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.270398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.280256 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:40.281731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.302318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] MFA Rules not processed for user `d9eb1b9e0f5a49528b8f8f215cf1cb4a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:40.303660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.355806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 957/1934] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:40.356956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.367513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d264f0dd-ca3f-4f1c-8845-79252b5889e4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.372493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.373123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.373722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.374010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.374694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.377562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.379274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 978/1935] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:40.380290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.395249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe31b7-5dbf-44ec-a1e3-04a851dc85a3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.400648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.401282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.401557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.401825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.402468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:40.402772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.403576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 958/1936] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/users => generated 311 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.404362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.404461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.415352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cb1214-4207-4e1f-aa55-a61804ff0036 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.420603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 979/1937] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:40.420603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.420846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.421255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.421597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.421931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.422550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.424430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.428861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4bd864-cd71-4063-aa32-991f3182fb25 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.433942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.434536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.434817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.435089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.435726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.437360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.448108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 980/1938] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:40.449037 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.455833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 959/1939] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.456642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.464158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db3014d-d138-413e-bf42-4146ae7fd082 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.500830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.520177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f398062e-ccf1-49e8-9a90-ff48aa52485b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.521682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.522287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.522595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.522873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.523541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.525030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.525419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.525716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.526020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.526288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] PATH_INFO: `/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2/users/20af9ee7548f4841bbbb3d3b28bb57b6/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.542164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bd1e85d52d4e39a51335aa1aadd5c2, user_id=20af9ee7548f4841bbbb3d3b28bb57b6, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.545793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.553215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 981/1940] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/projects => generated 375 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.554017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.557834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:40.560813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 960/1941] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:40 2022] PUT /identity/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2/users/20af9ee7548f4841bbbb3d3b28bb57b6/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:40.561669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.628562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8582599-ed52-4982-b58d-c3a5cb086ec0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.629141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe25627-c7c6-4197-b0a1-d0aabc407c07 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.633428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.636295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.636441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.636441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.636581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.636652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.636736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.636736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.636864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.636932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.637223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.637979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.663273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 961/1942] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/users => generated 288 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.664027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 982/1943] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:40.665017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.667586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.676198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d03b921-eb65-4aab-97f0-6a16926b1a18 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.679345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5020453b-d826-4ac2-9203-c1a1304d9f34 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.681614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.682291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.682882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.682882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.683479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.685200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.690686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.691308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.691652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.691926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.692656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.694160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.702879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 983/1944] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:40.703834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.713905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 962/1945] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:40.715193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.718025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf9a1b-6f5d-469b-ba59-3ffc46871a03 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.724054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.724670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.724953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.725286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.725937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.727530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.728338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f099d82a-7f59-46ca-b773-c96f00da89fd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.733636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.734941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.735656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.735656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] PATH_INFO: `/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2/users/20af9ee7548f4841bbbb3d3b28bb57b6/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.737916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=84bd1e85d52d4e39a51335aa1aadd5c2, user_id=20af9ee7548f4841bbbb3d3b28bb57b6, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.741399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.741708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 984/1946] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:40.743279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.755915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258e949-aa3c-4845-8350-6461c27752ff admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.769634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 963/1947] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:40 2022] PUT /identity/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2/users/20af9ee7548f4841bbbb3d3b28bb57b6/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:40.771702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.837751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.838423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.838752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.839018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] PATH_INFO: `/v3/projects/05cd77ee380143e4aa59672b8cc101c8/users/ce5a26cef40445ef8f5e6f3433620e53/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.856611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cd77ee380143e4aa59672b8cc101c8, user_id=ce5a26cef40445ef8f5e6f3433620e53, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.857140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0c463c-37d6-4d7a-bc87-8e9667fcc2d2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.860620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a76b15-a586-443b-a8b0-7c624e573608 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.880091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 985/1948] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:40 2022] PUT /identity/v3/projects/05cd77ee380143e4aa59672b8cc101c8/users/ce5a26cef40445ef8f5e6f3433620e53/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:40.883101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.884258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.884618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.886367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:40.887104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:40.887389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:40.887823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:40.888675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:40.891011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:40.912055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 964/1949] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:40.913039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:40.931523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] MFA Rules not processed for user `20af9ee7548f4841bbbb3d3b28bb57b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:40.941680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:40.955440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea6d70a-6f73-4973-8c3d-22aa3e126534 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:40.995660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:41.029928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:41.059156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.060086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.060267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.060546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.061196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.063197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.069597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 986/1950] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:40 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:41.069597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.078557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 965/1951] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:40 2022] GET /identity/v3/roles => generated 1420 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:41.083029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.084752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158f1862-90ac-4ef7-932e-ae764c26bf39 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.090448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.091179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.091461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.091725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] PATH_INFO: `/v3/projects/e044153df58a4a4c92c674bed8bc5504/users/6443c44785754f88a4f5ad78a7874ee0/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.094574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66473ef-939e-4022-8e82-13c88439fe56 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.099692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.100363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.100644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.100918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] PATH_INFO: `/v3/projects/05cd77ee380143e4aa59672b8cc101c8/users/ce5a26cef40445ef8f5e6f3433620e53/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.102869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05cd77ee380143e4aa59672b8cc101c8, user_id=ce5a26cef40445ef8f5e6f3433620e53, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.105595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.118702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 966/1952] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:41 2022] PUT /identity/v3/projects/05cd77ee380143e4aa59672b8cc101c8/users/ce5a26cef40445ef8f5e6f3433620e53/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:41.119527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.120488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e044153df58a4a4c92c674bed8bc5504, user_id=6443c44785754f88a4f5ad78a7874ee0, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.123241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1b2321-8a4e-49c9-8b36-49533091d1e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.128464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:41.139810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 987/1953] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:41 2022] PUT /identity/v3/projects/e044153df58a4a4c92c674bed8bc5504/users/6443c44785754f88a4f5ad78a7874ee0/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:41.139810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3da89f-85bb-44fa-9839-3a3b36c023f6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.140318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3da89f-85bb-44fa-9839-3a3b36c023f6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.140808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3da89f-85bb-44fa-9839-3a3b36c023f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.173460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dd3da89f-85bb-44fa-9839-3a3b36c023f6 None None] MFA Rules not processed for user `ce5a26cef40445ef8f5e6f3433620e53`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:41.174677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd3da89f-85bb-44fa-9839-3a3b36c023f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:41.195954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92935f89-03bf-4401-bd46-0ae3f15661a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.259266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.260146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.261203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.261492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.263241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 988/1954] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:41.264742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.265020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.266016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.317901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] MFA Rules not processed for user `6443c44785754f88a4f5ad78a7874ee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:41.319471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:41.371862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.373368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.384257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 967/1955] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:41.384930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.386322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:41.397753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e107ca5-e92a-4583-b650-2ea8f89cd14b service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.403177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.404039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.404324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.404604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.416817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.418237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.441246 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 968/1956] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:41.449608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 989/1957] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:41.457202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.476827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:41.481918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.493161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3e6a87-e546-489b-b686-a8ac7f3203c3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.497853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.498629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.498911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.499185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.501425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:41.538101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:41.543807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc70202-b4ae-4e68-b433-3c74a10c9b63 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.551569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.552170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.552451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.552724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.553417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.555397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.582312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.584065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.588848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 969/1958] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:41 2022] POST /identity/v3/projects => generated 375 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:41.589734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.596489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 990/1959] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:41.597923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.609649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456bca93-6789-4c2a-8d96-b08dfb29fc0d service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.682251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.682993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.683619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.684235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.684899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.685839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ff4f3-b903-4c55-8221-818489634ae2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.691687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.697070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.699076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.699700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.700676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.722661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 991/1960] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:41 2022] POST /identity/v3/users => generated 294 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:41.726290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.738787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f78833-8c47-4e6d-86a2-4b32472b7d9b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.744810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.745448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.745741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.746020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.746898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.748664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.760431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 992/1961] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:41.764551 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.776223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef084251-032b-488f-871f-0dd37e704e19 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.782323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.783510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.783791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.784138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] PATH_INFO: `/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a/users/a48fe496cf7a4b7cb866b724b91a131b/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.806880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.808390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.814807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f41b44cf3a4d01a73be8dd0540af7a, user_id=a48fe496cf7a4b7cb866b724b91a131b, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.817526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.820599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 970/1962] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:41.852775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 993/1963] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:41 2022] PUT /identity/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a/users/a48fe496cf7a4b7cb866b724b91a131b/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:41.862657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:41.876764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34796664-b9bc-4e38-ba07-ee98bf5b038c service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:41.936689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:41.974782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:41.975579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:41.975858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:41.976136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:41.976863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:41.978574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efabe65a-8aab-40f8-b072-bf3d87de6bbe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:41.994933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 971/1964] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:41 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:41.996639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:42.017785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09130703-79da-4d44-8589-968770e3c193 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:42.028404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:42.029381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.029789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.030306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] PATH_INFO: `/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a/users/a48fe496cf7a4b7cb866b724b91a131b/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.033503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15f41b44cf3a4d01a73be8dd0540af7a, user_id=a48fe496cf7a4b7cb866b724b91a131b, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:42.047034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:42.101375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 994/1965] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:41 2022] PUT /identity/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a/users/a48fe496cf7a4b7cb866b724b91a131b/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:42.113603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.114513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.116327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.149358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:42.151371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:42.199745 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] MFA Rules not processed for user `a48fe496cf7a4b7cb866b724b91a131b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:42.205871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:42.338609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2903830-d052-47ab-b70c-690edf832939 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:42.345770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:42.346895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.347724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.357138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] PATH_INFO: `/v3/users/8f655da9366f4c5b942e784c9d715195` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.359782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f655da9366f4c5b942e784c9d715195)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:42.362947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:42.403309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:42.411357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 972/1966] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:42 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:42.423722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:42.488151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f655da9366f4c5b942e784c9d715195'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:42.505868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f655da9366f4c5b942e784c9d715195'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:42.521762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f655da9366f4c5b942e784c9d715195'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:42.522537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f655da9366f4c5b942e784c9d715195'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:42.543194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0121c52-9e96-4292-a893-20c340fa70ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f655da9366f4c5b942e784c9d715195'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:42.552361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56257cdf-b35e-4c2c-968d-916d5ff22700 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:42.556498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 995/1967] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:42 2022] DELETE /identity/v3/users/8f655da9366f4c5b942e784c9d715195 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:42.558485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.558762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.559806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.585360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:42.587016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:42.667581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:42.668783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.669454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.670163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.677947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:42.693896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 996/1968] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:42.699378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:42.700835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:42.768101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:42.787066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebbda312-4527-4635-ad8e-17ee7e33c735 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:42.793545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:42.794453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:42.795027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:42.795942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:42.807429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:42.809644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:42.810046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:42.811704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:42.826323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 997/1969] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:42.832460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 973/1970] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:43.362265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:43.363732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:43.407976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5667adda-8739-48c0-a4b3-1c37e0e4403a service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:43.417786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:43.418678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:43.419133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:43.419694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] PATH_INFO: `/v3/projects/0baf00702c3941a086061a68bccb4f33` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:43.422256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0baf00702c3941a086061a68bccb4f33)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:43.425466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:43.474251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:43.502583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0baf00702c3941a086061a68bccb4f33', 'request_id': 'req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.517649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0baf00702c3941a086061a68bccb4f33', 'request_id': 'req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.528900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0baf00702c3941a086061a68bccb4f33', 'request_id': 'req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.544557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] The token cache is being invalidate because project 0baf00702c3941a086061a68bccb4f33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:43.545073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.545944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.548596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 998/1971] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:43 2022] DELETE /identity/v3/projects/0baf00702c3941a086061a68bccb4f33 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:43.552790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:43.566664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8481c83-cc5e-4c07-a28d-21398634c36f service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:43.670490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:43.671176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:43.672074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:43.672348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] PATH_INFO: `/v3/users/ed7769a7784640e2a0307a3f782a4817` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:43.673657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed7769a7784640e2a0307a3f782a4817)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:43.675706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:43.733969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed7769a7784640e2a0307a3f782a4817'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.743545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed7769a7784640e2a0307a3f782a4817'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.768134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed7769a7784640e2a0307a3f782a4817'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.770804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed7769a7784640e2a0307a3f782a4817'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.786384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-511b3066-2d60-422e-8075-021356ecd156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed7769a7784640e2a0307a3f782a4817'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:43.802670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 974/1972] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:43 2022] DELETE /identity/v3/users/ed7769a7784640e2a0307a3f782a4817 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:44.364786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:44.367310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:44.388276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b09bc9c-4caa-4988-9aa2-502a372d4d7d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:44.519925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:44.520685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:44.521359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:44.522315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] PATH_INFO: `/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:44.533154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a476aa9e27674c9a84d0f57c582a3f7e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:44.535529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:44.628919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a476aa9e27674c9a84d0f57c582a3f7e', 'request_id': 'req-09e8917f-5d2b-4bbf-bb73-869ab373851c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:44.642810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a476aa9e27674c9a84d0f57c582a3f7e', 'request_id': 'req-09e8917f-5d2b-4bbf-bb73-869ab373851c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:44.652510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a476aa9e27674c9a84d0f57c582a3f7e', 'request_id': 'req-09e8917f-5d2b-4bbf-bb73-869ab373851c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:44.675079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] The token cache is being invalidate because project a476aa9e27674c9a84d0f57c582a3f7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:44.675309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:44.676226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-09e8917f-5d2b-4bbf-bb73-869ab373851c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:44.678842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 999/1973] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:44 2022] DELETE /identity/v3/projects/a476aa9e27674c9a84d0f57c582a3f7e => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:44.683946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:44.684240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:44.684524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:44.725743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:44.726833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:44.836110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:44.871058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 975/1974] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:44.882300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:44.882692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:44.882986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:44.912222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:44.913598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:44.925969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1000/1975] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:44.931133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:44.948654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879306aa-6f8b-4c5e-b7c9-18bb4efdaae9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:44.962372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:44.964956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:44.965512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:44.965792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:44.966856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:44.967335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:44.969800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:44.987494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 976/1976] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:44.991829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.005106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8bea1-5077-4d76-b5e5-dc33632c0bad None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.015900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.018212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.022252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.022738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.024011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.030001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.089926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1001/1977] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:44 2022] POST /identity/v3/projects => generated 393 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:45.094639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.113931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc4c33f-d366-492f-8709-a70b94322fb3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.126668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.129506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.156782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:45.228457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef24358d-b435-4c21-bd5f-e0edda6f8014 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.230679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.233436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.233766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.234885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.235027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.235617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.235733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.235991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.236382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] PATH_INFO: `/v3/users/8029bc23909c422da12c794d590d75cd` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.238652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8029bc23909c422da12c794d590d75cd)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.241090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.241235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.297020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 977/1978] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:45 2022] POST /identity/v3/users => generated 297 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:45.297020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.306615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fde11d-dce2-4aa4-932d-35b58c374fa3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.311760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.312965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.313501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.313774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.314424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.316013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.330992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 978/1979] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:45.332014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.342173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8029bc23909c422da12c794d590d75cd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.345212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea3ed-3971-4dc5-a41e-7d0489586e48 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.351675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.352922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.353262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.353411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8029bc23909c422da12c794d590d75cd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.353567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.354408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.357067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.366021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8029bc23909c422da12c794d590d75cd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.366835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8029bc23909c422da12c794d590d75cd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.370853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 979/1980] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:45.375515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.378026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.395453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a55cfae5-6d29-4439-a767-4cb377dd123d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8029bc23909c422da12c794d590d75cd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.398831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8188f4f-8375-452d-b2be-c4f9d9e6bcab admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.406918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1002/1981] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:45 2022] DELETE /identity/v3/users/8029bc23909c422da12c794d590d75cd => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:45.408459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.408738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.409025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.412703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.413468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.413752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.414030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] PATH_INFO: `/v3/projects/0c3a7d72811e4179bb0557fe729d2612/users/7e527236604c4b5b8f25d6f1eff0a92a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.432963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:45.434117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.449916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c3a7d72811e4179bb0557fe729d2612, user_id=7e527236604c4b5b8f25d6f1eff0a92a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.456335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e017d0-f17c-4c4e-af57-5bcd84a5fb5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.486071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 980/1982] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:45 2022] PUT /identity/v3/projects/0c3a7d72811e4179bb0557fe729d2612/users/7e527236604c4b5b8f25d6f1eff0a92a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:45.496713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.497036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.502356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.555369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1003/1983] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:45.559546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] MFA Rules not processed for user `7e527236604c4b5b8f25d6f1eff0a92a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:45.560809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.566014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.567361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.612715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:45.644235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3faa83-942a-4548-a043-90445b1b11e3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.648515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 981/1984] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:45 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:45.654160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.673892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:45.739956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.740501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.740771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.741043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.752212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.755419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.767222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1004/1985] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:45.773698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c7dfda-a44a-477b-bc46-7ff2eadfbc7e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.775544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.777417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:45.782242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.784310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.789466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.790659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.791684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.794905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.800391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847eaa9a-da7c-4345-825f-dd8ec1cc5dbd service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:45.813686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:45.814469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:45.814944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:45.815445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] PATH_INFO: `/v3/users/6443c44785754f88a4f5ad78a7874ee0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:45.816889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6443c44785754f88a4f5ad78a7874ee0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:45.823475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:45.869247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 982/1986] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:45 2022] POST /identity/v3/projects => generated 391 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:45.873554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:45.915301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6443c44785754f88a4f5ad78a7874ee0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.927234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6443c44785754f88a4f5ad78a7874ee0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.960944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6443c44785754f88a4f5ad78a7874ee0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.961921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6443c44785754f88a4f5ad78a7874ee0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.982680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5e683da0-7b9f-4919-aa9f-e695be7d1fc1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6443c44785754f88a4f5ad78a7874ee0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:45.987478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23eccf7-e267-4f96-920a-2a3d94c10002 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.000996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.001944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.002312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.002675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.003506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.006197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.007904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1005/1987] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:45 2022] DELETE /identity/v3/users/6443c44785754f88a4f5ad78a7874ee0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:46.012053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.012342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.012617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.036608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 983/1988] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:45 2022] POST /identity/v3/users => generated 302 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:46.037574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.039577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.052451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:46.053716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.056912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d77265c-342f-4f27-9933-1d3cf724965f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.160121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1006/1989] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:46.186015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.187840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.191710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.191710 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.193344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.193815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.194683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.196778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.201620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:46.209790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 984/1990] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:46.210726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.212393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.227657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7409c89f-6882-4099-8337-c1255bf08f54 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.232870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.233902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.234292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.234704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] PATH_INFO: `/v3/projects/3530ad1d7a0b4576ab40fdb87182bcc2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.236064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3530ad1d7a0b4576ab40fdb87182bcc2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.238843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.264040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:46.268382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd98380f-111e-4883-840a-f9114c13f644 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.275952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.276958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.277347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.277655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.298635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.300074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.301337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3530ad1d7a0b4576ab40fdb87182bcc2', 'request_id': 'req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.309703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3530ad1d7a0b4576ab40fdb87182bcc2', 'request_id': 'req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.310644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1007/1991] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:46.311948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.318580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3530ad1d7a0b4576ab40fdb87182bcc2', 'request_id': 'req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.329844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2300a3a4-ac91-4c14-8b7a-8fd80d254505 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.342242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] The token cache is being invalidate because project 3530ad1d7a0b4576ab40fdb87182bcc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:46.342579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.344533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.352455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 985/1992] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:46 2022] DELETE /identity/v3/projects/3530ad1d7a0b4576ab40fdb87182bcc2 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:46.354542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.356539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.448656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.449395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.449676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.450019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] PATH_INFO: `/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1/users/304faa6fd2b8443b93a9fc710e354f96/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.493629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fe8961b31843ad8982e1c09d0bd5a1, user_id=304faa6fd2b8443b93a9fc710e354f96, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.496359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.501685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3faaf4-2a6c-43f0-850a-4f31d3cb695b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.511948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.514415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.514694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.515779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] PATH_INFO: `/v3/users/d9eb1b9e0f5a49528b8f8f215cf1cb4a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.518048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9eb1b9e0f5a49528b8f8f215cf1cb4a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.519168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1008/1993] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:46 2022] PUT /identity/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1/users/304faa6fd2b8443b93a9fc710e354f96/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:46.521327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.525229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.527649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.628930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5d0f43-4529-4654-bd76-e911c22ff8f7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.637304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9eb1b9e0f5a49528b8f8f215cf1cb4a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.640001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.642225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.642559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.643400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.644434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.646800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.662616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9eb1b9e0f5a49528b8f8f215cf1cb4a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.690255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9eb1b9e0f5a49528b8f8f215cf1cb4a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.694849 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9eb1b9e0f5a49528b8f8f215cf1cb4a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.695017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1009/1994] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:46 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:46.696519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:46.716762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3bc0f23-5357-4aee-89d4-7a9fa0abddcb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9eb1b9e0f5a49528b8f8f215cf1cb4a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:46.727946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 986/1995] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:46 2022] DELETE /identity/v3/users/d9eb1b9e0f5a49528b8f8f215cf1cb4a => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:46.733120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b1607-cd90-4505-b4eb-c3df2d4678c8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:46.783698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:46.831311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:46.832789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.833311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.834020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] PATH_INFO: `/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1/users/304faa6fd2b8443b93a9fc710e354f96/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.837375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21fe8961b31843ad8982e1c09d0bd5a1, user_id=304faa6fd2b8443b93a9fc710e354f96, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:46.840663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:46.868610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1010/1996] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:46 2022] PUT /identity/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1/users/304faa6fd2b8443b93a9fc710e354f96/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:46.883034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:46.883592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:46.883879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:46.967180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] MFA Rules not processed for user `304faa6fd2b8443b93a9fc710e354f96`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:46.969299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:46.997279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:47.023131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.026200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.076696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 987/1997] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:46 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:47.092152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.092152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.148907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5c7417-2ad6-4ce1-9122-248a14b46301 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.154007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.154718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.155118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.155398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] PATH_INFO: `/v3/projects/e044153df58a4a4c92c674bed8bc5504` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.157667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e044153df58a4a4c92c674bed8bc5504)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:47.159645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:47.175154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244a5eaa-bdd5-48ea-9cf5-f4dd485d5e7f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.183511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.184150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.184436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.185297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.197795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:47.199819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:47.211920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 988/1998] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:47 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:47.226545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e044153df58a4a4c92c674bed8bc5504', 'request_id': 'req-c58964b6-25d1-45e3-99b9-885f73dbc8a7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.237682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e044153df58a4a4c92c674bed8bc5504', 'request_id': 'req-c58964b6-25d1-45e3-99b9-885f73dbc8a7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.244224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e044153df58a4a4c92c674bed8bc5504', 'request_id': 'req-c58964b6-25d1-45e3-99b9-885f73dbc8a7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.260074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] The token cache is being invalidate because project e044153df58a4a4c92c674bed8bc5504 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:47.260074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.260074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.268956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.269452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1011/1999] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:47 2022] DELETE /identity/v3/projects/e044153df58a4a4c92c674bed8bc5504 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:47.273070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.275139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.276577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.287820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf370f51-4721-4e70-a1c6-01c0e6b62fc5 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.352794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.353472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.354376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.354376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.356445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.362764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:47.383696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58964b6-25d1-45e3-99b9-885f73dbc8a7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.403244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.403510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.403802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.404141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] PATH_INFO: `/v3/users/a48fe496cf7a4b7cb866b724b91a131b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.407552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=a48fe496cf7a4b7cb866b724b91a131b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:47.409040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:47.481003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:47.482881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:47.493452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a48fe496cf7a4b7cb866b724b91a131b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.495504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 989/2000] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:47 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:47.496327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.499531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.505502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a48fe496cf7a4b7cb866b724b91a131b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.516128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654ca513-f17c-4ed3-ae5c-a8add09ae781 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.519642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a48fe496cf7a4b7cb866b724b91a131b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.520567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a48fe496cf7a4b7cb866b724b91a131b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.523305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.523305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.523305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.524581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] PATH_INFO: `/v3/projects/341ca38e20374ed8bfda89e0c1e9f9ed` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.526254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] RBAC: Authorizing `identity:delete_project(project_id=341ca38e20374ed8bfda89e0c1e9f9ed)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:47.527993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:47.531956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:47.547566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a48fe496cf7a4b7cb866b724b91a131b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.557950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1012/2001] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:47 2022] DELETE /identity/v3/users/a48fe496cf7a4b7cb866b724b91a131b => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:47.618469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '341ca38e20374ed8bfda89e0c1e9f9ed', 'request_id': 'req-235c59e2-766e-40d7-a42c-32095066486b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.628855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '341ca38e20374ed8bfda89e0c1e9f9ed', 'request_id': 'req-235c59e2-766e-40d7-a42c-32095066486b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.640695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '341ca38e20374ed8bfda89e0c1e9f9ed', 'request_id': 'req-235c59e2-766e-40d7-a42c-32095066486b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.683451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] The token cache is being invalidate because project 341ca38e20374ed8bfda89e0c1e9f9ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:47.683754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.685386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:47.687870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 990/2002] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:47 2022] DELETE /identity/v3/projects/341ca38e20374ed8bfda89e0c1e9f9ed => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:47.693342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:47.695214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:47.841148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedeb3b-87ae-444e-89e7-3aedd81c08ca admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:47.991549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:47.993609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:47.994372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:47.994659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] PATH_INFO: `/v3/users/ce5a26cef40445ef8f5e6f3433620e53` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:47.997029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce5a26cef40445ef8f5e6f3433620e53)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.001723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.038288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:48.086321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce5a26cef40445ef8f5e6f3433620e53'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.101795 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce5a26cef40445ef8f5e6f3433620e53'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.126641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce5a26cef40445ef8f5e6f3433620e53'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.127394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce5a26cef40445ef8f5e6f3433620e53'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.144870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.146489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.155329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce5a26cef40445ef8f5e6f3433620e53'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.162091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235c59e2-766e-40d7-a42c-32095066486b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.165955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1013/2003] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:47 2022] DELETE /identity/v3/users/ce5a26cef40445ef8f5e6f3433620e53 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:48.219180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.223532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.293284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.296474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.297634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.298321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] PATH_INFO: `/v3/users/0331e59fe4384fe9a43974b469059002` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.299650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0331e59fe4384fe9a43974b469059002)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.303420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.376724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8323b67e-f725-481c-8c68-0aea50119ba4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.382105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.383310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.383310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.383310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] PATH_INFO: `/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.384664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=15f41b44cf3a4d01a73be8dd0540af7a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.386792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.406907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0331e59fe4384fe9a43974b469059002'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.417560 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0331e59fe4384fe9a43974b469059002'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.447462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15f41b44cf3a4d01a73be8dd0540af7a', 'request_id': 'req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.459793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15f41b44cf3a4d01a73be8dd0540af7a', 'request_id': 'req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.460229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0331e59fe4384fe9a43974b469059002'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.460932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0331e59fe4384fe9a43974b469059002'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.471799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15f41b44cf3a4d01a73be8dd0540af7a', 'request_id': 'req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.474455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-67a455c1-85fa-449d-8f9b-07f0b33792a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0331e59fe4384fe9a43974b469059002'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.483422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 991/2004] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:48 2022] DELETE /identity/v3/users/0331e59fe4384fe9a43974b469059002 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:48.488727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c8db-3783-4829-98c6-4469c9632e47 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.489762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c8db-3783-4829-98c6-4469c9632e47 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.490501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e975c8db-3783-4829-98c6-4469c9632e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.490864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] The token cache is being invalidate because project 15f41b44cf3a4d01a73be8dd0540af7a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:48.491344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.492590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9078e9c3-b4ed-4eb1-bd25-fbe77493dbd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.494801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1014/2005] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:48 2022] DELETE /identity/v3/projects/15f41b44cf3a4d01a73be8dd0540af7a => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:48.500647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.500938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.501374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.519407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e975c8db-3783-4829-98c6-4469c9632e47 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:48.521500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e975c8db-3783-4829-98c6-4469c9632e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.527100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:48.528302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.532556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:48.558626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:48.635228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1015/2006] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:48.635228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.635228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.643778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 992/2007] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:48.645027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad37ffe-2867-4d0a-8c7d-6749fa780491 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.645883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15532-1820-4513-8733-40005565be91 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.646174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15532-1820-4513-8733-40005565be91 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.646446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde15532-1820-4513-8733-40005565be91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.664284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.664943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.665253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.665529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] PATH_INFO: `/v3/projects/05cd77ee380143e4aa59672b8cc101c8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.666683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05cd77ee380143e4aa59672b8cc101c8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.668595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.669212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bde15532-1820-4513-8733-40005565be91 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:48.670538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bde15532-1820-4513-8733-40005565be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.680289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 993/2008] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:48.684210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15532-1820-4513-8733-40005565be91 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.686066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bde15532-1820-4513-8733-40005565be91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.725648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05cd77ee380143e4aa59672b8cc101c8', 'request_id': 'req-24cbf849-97ad-4bb6-ab7b-84581ad220b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.735169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05cd77ee380143e4aa59672b8cc101c8', 'request_id': 'req-24cbf849-97ad-4bb6-ab7b-84581ad220b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.742000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05cd77ee380143e4aa59672b8cc101c8', 'request_id': 'req-24cbf849-97ad-4bb6-ab7b-84581ad220b1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.753422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde15532-1820-4513-8733-40005565be91 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.754315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] The token cache is being invalidate because project 05cd77ee380143e4aa59672b8cc101c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:48.754923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.755616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:48.762091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1016/2009] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:48 2022] DELETE /identity/v3/projects/05cd77ee380143e4aa59672b8cc101c8 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:48.762091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.762091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.830943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.831566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.831847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.832118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.833909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.848442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cbf849-97ad-4bb6-ab7b-84581ad220b1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.848586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.850264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758a060f-c64f-41e8-a40f-e5f1cd985b7b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.857595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.858414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.858775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.859119 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.859843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:48.860287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.862024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 994/2010] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:48.862134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.863200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda778-f68a-4cab-aa66-16265f80bbc1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.863554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda778-f68a-4cab-aa66-16265f80bbc1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.864079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76cda778-f68a-4cab-aa66-16265f80bbc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.879394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1017/2011] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:48.880461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.891280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-76cda778-f68a-4cab-aa66-16265f80bbc1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:48.891739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70614c44-0361-4594-ac7c-ad2d9209ad56 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:48.892791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76cda778-f68a-4cab-aa66-16265f80bbc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.897593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:48.898221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.898504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.898780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.899423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:48.901748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:48.909344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 995/2012] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:48.912329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:48.912624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:48.912904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:48.948128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:48.948128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:48.961063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 996/2013] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:48.962139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.963819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1018/2014] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:48.967752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:48.978233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347dd8fc-2333-4d05-83b2-0849b5473ffd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.007005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:49.065746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402cf664-d06c-43c8-b60f-3d7f3d5ea05d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.066640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:49.075938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.076904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.078127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.079296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.079720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.080103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.081365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.082007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.082293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.082415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.082960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:49.083267 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.084856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.110507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 997/2015] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:49.111401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.117234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1019/2016] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:48 2022] POST /identity/v3/users => generated 299 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:49.118579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.144796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67152b11-6402-44f1-b7ee-6920f4cfe966 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.149278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e4ee9f-4eb6-4f19-9949-3654f8c5f87d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.157418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.159947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.160360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.160654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.161870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.161983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.162445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.162553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.162730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.164496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.166711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.168026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.190556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1020/2017] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:49.193865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.219760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c4a2a4-1c2a-4ae3-861d-ca9468143155 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.242541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 998/2018] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:49 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:49.243026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.243656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.243940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.244217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.244866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.245642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.246691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.273751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1021/2019] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:49.277908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.295272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ad6ef-4768-4b19-abcf-24d74b42e8e0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.353562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f60d98-fb17-413b-8b19-0cab5ff0b1a4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.367034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.367985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.368521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.369133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.370126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.375754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.415621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.416324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.416606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.416883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] PATH_INFO: `/v3/projects/70a36d0f924b41f28d07ffd9c5570ebd/users/d4a991c6c4b94937ab6488a31b129d56/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.427156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 999/2020] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:49 2022] POST /identity/v3/users => generated 290 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:49.428611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.430548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:49.448712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29de7970-ecd2-4e47-993f-3803ccad2e15 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.457742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.458513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.458857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.459200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] PATH_INFO: `/v3/projects/4b5fccfdbd0b4520aa6a4511fbe2d234` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.460475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b5fccfdbd0b4520aa6a4511fbe2d234)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.462678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.482377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70a36d0f924b41f28d07ffd9c5570ebd, user_id=d4a991c6c4b94937ab6488a31b129d56, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.486223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.514286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1022/2021] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:49 2022] PUT /identity/v3/projects/70a36d0f924b41f28d07ffd9c5570ebd/users/d4a991c6c4b94937ab6488a31b129d56/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:49.516956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.550376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b5fccfdbd0b4520aa6a4511fbe2d234', 'request_id': 'req-0531b464-208f-44e4-ade4-5acec0e845f9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.559145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b5fccfdbd0b4520aa6a4511fbe2d234', 'request_id': 'req-0531b464-208f-44e4-ade4-5acec0e845f9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.567234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b5fccfdbd0b4520aa6a4511fbe2d234', 'request_id': 'req-0531b464-208f-44e4-ade4-5acec0e845f9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.584147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] The token cache is being invalidate because project 4b5fccfdbd0b4520aa6a4511fbe2d234 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:49.584505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.585313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0531b464-208f-44e4-ade4-5acec0e845f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.590038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1000/2022] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:49 2022] DELETE /identity/v3/projects/4b5fccfdbd0b4520aa6a4511fbe2d234 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:49.590038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.590038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.590038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.603680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae027d65-a1b9-49ea-847f-7d420d996744 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.625451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:49.646092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] MFA Rules not processed for user `d4a991c6c4b94937ab6488a31b129d56`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:49.647512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:49.686186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:49.704026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.705494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.707205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.707496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.709267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.711518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.730405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1023/2023] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:49.730405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.731628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:49.755072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f2f31c-f04e-4bbb-8166-c36bd318695d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.761601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.763847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.764140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.764441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] PATH_INFO: `/v3/users/20af9ee7548f4841bbbb3d3b28bb57b6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.766228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=20af9ee7548f4841bbbb3d3b28bb57b6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.768482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.778980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1001/2024] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:49 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:49.785241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.785241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:49.804418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef71f98-1b56-425f-a881-dff43c66fa35 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:49.855541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:49.857804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:49.858247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:49.858550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:49.871022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:49.878452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:49.888326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20af9ee7548f4841bbbb3d3b28bb57b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.892024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1002/2025] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:49 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:49.892956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.894726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:49.906885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20af9ee7548f4841bbbb3d3b28bb57b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.930154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20af9ee7548f4841bbbb3d3b28bb57b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.931182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20af9ee7548f4841bbbb3d3b28bb57b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.959139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20af9ee7548f4841bbbb3d3b28bb57b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:49.975543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1024/2026] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:49 2022] DELETE /identity/v3/users/20af9ee7548f4841bbbb3d3b28bb57b6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:49.976784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:49.978054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:50.028583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e78a17-c4ad-417a-888b-420d14421774 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:50.134795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:50.135082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:50.135362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:50.135637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:50.140578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:50.142262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8313d181-9515-41ed-8b03-47f87c3e85ac admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:50.153497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:50.154754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:50.155044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:50.155325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] PATH_INFO: `/v3/projects/575548fa6e0e4d3f93c1e2c335f98b0a/users/16a3f6613c2c4a96948fdcef1e3010c9/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:50.192620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=575548fa6e0e4d3f93c1e2c335f98b0a, user_id=16a3f6613c2c4a96948fdcef1e3010c9, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:50.199210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d790d0-bd92-44b0-8c1d-419bd7236239 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:50.226396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1025/2027] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:49 2022] PUT /identity/v3/projects/575548fa6e0e4d3f93c1e2c335f98b0a/users/16a3f6613c2c4a96948fdcef1e3010c9/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:50.238918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:50.239476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:50.239897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:50.278220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:50.281647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:50.300352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:50.301731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1003/2028] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:49 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:50.311650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] MFA Rules not processed for user `16a3f6613c2c4a96948fdcef1e3010c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:50.313706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:50.465713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1026/2029] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:50.470750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:50.494293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3a40f-58ec-4fd9-a8bb-4a75ea116bba service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:50.554255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:50.671805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:50.672250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:50.673683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:50.673969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:50.675786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:50.682081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:50.749598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1004/2030] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:50 2022] POST /identity/v3/projects => generated 381 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:50.750838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:50.763071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bb670b-1856-4d34-8691-bd93e38d287c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:50.906922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:50.907640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:50.907992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:50.908370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:50.909074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:50.912216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:50.994934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.007370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1027/2031] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:50 2022] POST /identity/v3/users => generated 297 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:51.014992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d033f10-3cd7-406e-806e-7d85a6cadd2c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.021641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.023154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.023748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.024257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.025302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.028259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.058803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.061240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1005/2032] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:50 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:51.075314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26e718-5916-4fb2-8270-44bedb0f48d9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.082126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.082773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.085239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.085536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] PATH_INFO: `/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c/users/d46c81405950439c9c41bb971b8514ec/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.118351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4b52e9543845e09aeb4bc7f86c2d8c, user_id=d46c81405950439c9c41bb971b8514ec, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.121728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.153646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.156678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:51.174765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1028/2033] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:51 2022] PUT /identity/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c/users/d46c81405950439c9c41bb971b8514ec/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:51.176548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.186048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7dcf03e-1fba-48bd-a755-3c731347d810 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.308877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.309801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.310057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.310629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] PATH_INFO: `/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.312740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] RBAC: Authorizing `identity:delete_project(project_id=84bd1e85d52d4e39a51335aa1aadd5c2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.314709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.341369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ab30bc-c674-457d-9fd8-f56e9893dd3e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.348542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.349552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.349999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.350564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.352232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.354693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.375831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1029/2034] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:51.380232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.385685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '84bd1e85d52d4e39a51335aa1aadd5c2', 'request_id': 'req-fe5dfe39-3cf1-4c71-82df-1832fff55810'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:51.390500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:51.394705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c8effd-cda6-44e1-ba9d-3515fc2f9fb0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.394843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '84bd1e85d52d4e39a51335aa1aadd5c2', 'request_id': 'req-fe5dfe39-3cf1-4c71-82df-1832fff55810'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:51.402467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '84bd1e85d52d4e39a51335aa1aadd5c2', 'request_id': 'req-fe5dfe39-3cf1-4c71-82df-1832fff55810'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:51.427163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] The token cache is being invalidate because project 84bd1e85d52d4e39a51335aa1aadd5c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:51.427832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:51.428610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fe5dfe39-3cf1-4c71-82df-1832fff55810 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:51.431254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1006/2035] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:51 2022] DELETE /identity/v3/projects/84bd1e85d52d4e39a51335aa1aadd5c2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:51.437268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866cb1-7b28-40f3-a6b8-f4e2b1decf56 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.437706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866cb1-7b28-40f3-a6b8-f4e2b1decf56 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.438385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0866cb1-7b28-40f3-a6b8-f4e2b1decf56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.467058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b0866cb1-7b28-40f3-a6b8-f4e2b1decf56 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:51.469327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b0866cb1-7b28-40f3-a6b8-f4e2b1decf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:51.476982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.478318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.478318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.478318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] PATH_INFO: `/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c/users/d46c81405950439c9c41bb971b8514ec/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.480290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e4b52e9543845e09aeb4bc7f86c2d8c, user_id=d46c81405950439c9c41bb971b8514ec, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.483077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0273b375-6a2a-4b35-a7b2-174b55d2a50e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.494925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1030/2036] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:51 2022] PUT /identity/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c/users/d46c81405950439c9c41bb971b8514ec/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:51.502709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:51.509004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.509346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.509633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.544073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] MFA Rules not processed for user `d46c81405950439c9c41bb971b8514ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:51.545326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:51.558351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1007/2037] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:51.560944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.561283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.561668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.586109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:51.587133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:51.634679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1031/2038] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:51.645228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.646568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:51.686532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1008/2039] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:51.688513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.700945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95524a91-a65f-470d-b67f-a41b0eb9798f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.712918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.712918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.712918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.712918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.713299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:51.713299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.713299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.729315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc72ec88-2578-4668-91d1-4bfe4b01f65f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.733223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1009/2040] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:51.738049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.738852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.739524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.739835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.740111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.750722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f57fc-164c-4525-bea6-67e8ebc04e89 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.752994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.755277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.756078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.756959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.757474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.757947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.758774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.760874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.777333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1032/2041] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:51.800338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1010/2042] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:51 2022] POST /identity/v3/projects => generated 387 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:51.804885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.819775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211036af-7dc9-435e-a876-853bc79954b0 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.862632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:51.910207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.910837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.911114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.911665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.912925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:51.914960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:51.947677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1033/2043] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:51 2022] POST /identity/v3/users => generated 294 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:51.951473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:51.967262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3473762-b58b-47d2-bad6-6e361b2efa0b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:51.993176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:51.994186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:51.994482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:51.996609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:51.997228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.003375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.036845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1011/2044] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:51 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:52.040308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.055600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc83326a-7c38-4b7f-916b-aafc197b7c31 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.063900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.064646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.065032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.065491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.066263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.068153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a6f14-a9da-4a6e-9754-94948fd7184e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.085779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1034/2045] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:52.086217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.098245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26acdf59-ae46-4953-8353-78f9f85a690e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.109544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.110446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.110890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.111348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] PATH_INFO: `/v3/projects/b49bba9b58864cf48c676cde6ea7853d/users/3b97cc05fc4041d888ac2901fc00471f/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.134974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b49bba9b58864cf48c676cde6ea7853d, user_id=3b97cc05fc4041d888ac2901fc00471f, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.138290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.160457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1012/2046] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:52 2022] PUT /identity/v3/projects/b49bba9b58864cf48c676cde6ea7853d/users/3b97cc05fc4041d888ac2901fc00471f/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:52.171744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.172062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.172326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.264488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] MFA Rules not processed for user `3b97cc05fc4041d888ac2901fc00471f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:52.266808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:52.345732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.348498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:52.396345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1035/2047] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:52.402478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.488640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca8ff22-1c4b-43e8-9d0b-485641446acd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.501970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.501970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.501970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.501970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] PATH_INFO: `/v3/users/7e527236604c4b5b8f25d6f1eff0a92a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.502262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e527236604c4b5b8f25d6f1eff0a92a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.505446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.507505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:52.531242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108f9625-5b57-4718-9548-9075b0a2bb70 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.539669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.540290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.540571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.540844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.541650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.543585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.589657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e527236604c4b5b8f25d6f1eff0a92a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:52.604772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e527236604c4b5b8f25d6f1eff0a92a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:52.616129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1036/2048] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:52 2022] POST /identity/v3/projects => generated 387 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:52.618201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.620746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:52.625040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e527236604c4b5b8f25d6f1eff0a92a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:52.626037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e527236604c4b5b8f25d6f1eff0a92a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:52.636935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e527236604c4b5b8f25d6f1eff0a92a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:52.652305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1013/2049] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:52 2022] DELETE /identity/v3/users/7e527236604c4b5b8f25d6f1eff0a92a => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:52.652305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.653517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:52.686420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:52.754904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8634b71-de80-4b53-bc98-fcec4c1d6395 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.762604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.763369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.763833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.764210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.765691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.768082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13354f28-85aa-418d-8abd-a004ebe23fa1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.801466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1014/2050] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:52 2022] POST /identity/v3/users => generated 300 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:52.802930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.803352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.803757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.860464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:52.863549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:52.901162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1015/2051] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:52.902046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:52.910851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf4d97f-d8c2-444f-9ebf-650bdbcfac64 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.923192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.923895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.924184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.924525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] PATH_INFO: `/v3/users/16a3f6613c2c4a96948fdcef1e3010c9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.925843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2390ed-0138-42a5-97ca-f37089fc53cc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:52.927175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=16a3f6613c2c4a96948fdcef1e3010c9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.930921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.950666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:52.951222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:52.952347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:52.952766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:52.953509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:52.955133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:52.998039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1016/2052] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:52 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:52.999693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.006272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.013757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '16a3f6613c2c4a96948fdcef1e3010c9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:53.026849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '16a3f6613c2c4a96948fdcef1e3010c9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:53.039292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '16a3f6613c2c4a96948fdcef1e3010c9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:53.041669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '16a3f6613c2c4a96948fdcef1e3010c9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:53.061415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '16a3f6613c2c4a96948fdcef1e3010c9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:53.075248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1037/2053] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:52 2022] DELETE /identity/v3/users/16a3f6613c2c4a96948fdcef1e3010c9 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:53.076547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.079320 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.147475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793664e8-cd3b-4f1b-9d48-ff741e41889a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.154220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:53.181939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba7c5f6-96b5-47a5-9255-03fb16fc98d9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.187837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.188796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.189611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.189611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] PATH_INFO: `/v3/projects/e496d4e87a5e4d1eb254da837877ddf8/users/1484450292ac43548e78c0c53dbc19dc/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.209375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=e496d4e87a5e4d1eb254da837877ddf8, user_id=1484450292ac43548e78c0c53dbc19dc, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.212286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8026fc7-ca56-4144-b2d7-5e733e1862ab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.238425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1038/2054] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:53 2022] PUT /identity/v3/projects/e496d4e87a5e4d1eb254da837877ddf8/users/1484450292ac43548e78c0c53dbc19dc/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:53.240044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.240335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.240610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.246904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cb618-946c-4550-afba-907274decf08 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.247469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb618-946c-4550-afba-907274decf08 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.247757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb618-946c-4550-afba-907274decf08 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.248034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096cb618-946c-4550-afba-907274decf08 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.251113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-096cb618-946c-4550-afba-907274decf08 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.265401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb618-946c-4550-afba-907274decf08 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.267059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096cb618-946c-4550-afba-907274decf08 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.279188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1017/2055] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:53.280921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cb618-946c-4550-afba-907274decf08 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.284660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:53.288387 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.296618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096cb618-946c-4550-afba-907274decf08 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.327844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:53.363528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.364321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.364607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.365216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.365998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.367620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.383794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1018/2056] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:53.384877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.396272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7164e0-dbcc-44e4-a0b8-240d90ee8e9c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.401057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.401790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.402071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.402347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] PATH_INFO: `/v3/projects/e496d4e87a5e4d1eb254da837877ddf8/users/1484450292ac43548e78c0c53dbc19dc/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.404554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e496d4e87a5e4d1eb254da837877ddf8, user_id=1484450292ac43548e78c0c53dbc19dc, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.409093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c42a12-21ae-4308-af7d-f7ee62be65a4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.425300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1019/2057] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:53 2022] PUT /identity/v3/projects/e496d4e87a5e4d1eb254da837877ddf8/users/1484450292ac43548e78c0c53dbc19dc/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:53.435369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.435684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.438950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.440771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1039/2058] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:53.451715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.453450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.513527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] MFA Rules not processed for user `1484450292ac43548e78c0c53dbc19dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:53.517383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.552672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57568d0-55dd-498c-80d7-2bfee530dce2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.634337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.635610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.635610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.635800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.682419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1020/2059] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:53 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:53.694583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:53.697050 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:53.743107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:53.777895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.782041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.800733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1040/2060] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:53.807680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a18a5d7-2a05-4811-b6b4-f88de1b651c4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:53.824315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:53.825380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:53.825864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:53.826336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:53.868352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:53.870219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:53.888102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1021/2061] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:53 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:54.410358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:54.412263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:54.426662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7ecbd7-e5cb-40e1-8941-2e13d1508ef4 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:54.434568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:54.435534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:54.436060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:54.437175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] PATH_INFO: `/v3/projects/0c3a7d72811e4179bb0557fe729d2612` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:54.440917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c3a7d72811e4179bb0557fe729d2612)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:54.449269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:54.486380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:54.518904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:54.520855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:54.525994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c3a7d72811e4179bb0557fe729d2612', 'request_id': 'req-cf798564-61aa-4b7a-9e48-4fac24ac87db'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.536674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c3a7d72811e4179bb0557fe729d2612', 'request_id': 'req-cf798564-61aa-4b7a-9e48-4fac24ac87db'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.545685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d564aab-1479-4f96-b8e1-2f966146a886 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:54.546285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c3a7d72811e4179bb0557fe729d2612', 'request_id': 'req-cf798564-61aa-4b7a-9e48-4fac24ac87db'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.559341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] The token cache is being invalidate because project 0c3a7d72811e4179bb0557fe729d2612 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:54.559775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.560615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.565261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1041/2062] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:54 2022] DELETE /identity/v3/projects/0c3a7d72811e4179bb0557fe729d2612 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:54.569892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:54.572014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:54.636620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:54.638106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:54.638401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:54.638687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] PATH_INFO: `/v3/projects/575548fa6e0e4d3f93c1e2c335f98b0a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:54.640179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] RBAC: Authorizing `identity:delete_project(project_id=575548fa6e0e4d3f93c1e2c335f98b0a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:54.642489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:54.655142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf798564-61aa-4b7a-9e48-4fac24ac87db admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:54.663810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:54.663810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:54.663810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:54.663810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] PATH_INFO: `/v3/users/304faa6fd2b8443b93a9fc710e354f96` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:54.665765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] RBAC: Authorizing `identity:delete_user(user_id=304faa6fd2b8443b93a9fc710e354f96)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:54.668801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:54.708460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '575548fa6e0e4d3f93c1e2c335f98b0a', 'request_id': 'req-c419dde4-6aea-4750-b45e-fd9768aef347'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.724392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '575548fa6e0e4d3f93c1e2c335f98b0a', 'request_id': 'req-c419dde4-6aea-4750-b45e-fd9768aef347'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.732049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '575548fa6e0e4d3f93c1e2c335f98b0a', 'request_id': 'req-c419dde4-6aea-4750-b45e-fd9768aef347'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.739048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '304faa6fd2b8443b93a9fc710e354f96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.747456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '304faa6fd2b8443b93a9fc710e354f96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.754620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] The token cache is being invalidate because project 575548fa6e0e4d3f93c1e2c335f98b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:54.754912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.755631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '304faa6fd2b8443b93a9fc710e354f96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.755751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.756585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '304faa6fd2b8443b93a9fc710e354f96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.757413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1022/2063] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:54 2022] DELETE /identity/v3/projects/575548fa6e0e4d3f93c1e2c335f98b0a => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:54.763038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:54.765826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:54.773955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '304faa6fd2b8443b93a9fc710e354f96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:54.781659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1042/2064] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:54 2022] DELETE /identity/v3/users/304faa6fd2b8443b93a9fc710e354f96 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:54.829450 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:54.847619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c419dde4-6aea-4750-b45e-fd9768aef347 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:54.922065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:54.922065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:54.922065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:54.922065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] PATH_INFO: `/v3/users/d46c81405950439c9c41bb971b8514ec` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:54.922491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d46c81405950439c9c41bb971b8514ec)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:54.923707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:54.924612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:54.925476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:54.945953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb1ca49-117c-4ef7-947d-d6d4defc548b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:54.953169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:54.957584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:54.957876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:54.958181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] PATH_INFO: `/v3/users/3b97cc05fc4041d888ac2901fc00471f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:54.959505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3b97cc05fc4041d888ac2901fc00471f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:54.961992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.003172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd46c81405950439c9c41bb971b8514ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.013990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:55.016625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd46c81405950439c9c41bb971b8514ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.036191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd46c81405950439c9c41bb971b8514ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.037110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd46c81405950439c9c41bb971b8514ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.044184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3b97cc05fc4041d888ac2901fc00471f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.047510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd46c81405950439c9c41bb971b8514ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.055038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3b97cc05fc4041d888ac2901fc00471f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.057402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1023/2065] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:54 2022] DELETE /identity/v3/users/d46c81405950439c9c41bb971b8514ec => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:55.075588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3b97cc05fc4041d888ac2901fc00471f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.076271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3b97cc05fc4041d888ac2901fc00471f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.105974 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d8981bbb-ae25-463d-b51f-4473d21f4a39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3b97cc05fc4041d888ac2901fc00471f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.117629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1043/2066] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:54 2022] DELETE /identity/v3/users/3b97cc05fc4041d888ac2901fc00471f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:55.119190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.120740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.123547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.124082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.126141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.168350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:55.170568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.229852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc01790-ed94-462a-a7b6-fd3e13d44b48 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.254317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1044/2067] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:55.264093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:55.264265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.269666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.314754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.315421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.315703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.315967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] PATH_INFO: `/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.317785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21fe8961b31843ad8982e1c09d0bd5a1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.321321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.407024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21fe8961b31843ad8982e1c09d0bd5a1', 'request_id': 'req-c1312986-7b5b-4937-adef-045cd5b6d746'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.414758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21fe8961b31843ad8982e1c09d0bd5a1', 'request_id': 'req-c1312986-7b5b-4937-adef-045cd5b6d746'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.421502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21fe8961b31843ad8982e1c09d0bd5a1', 'request_id': 'req-c1312986-7b5b-4937-adef-045cd5b6d746'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.451135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] The token cache is being invalidate because project 21fe8961b31843ad8982e1c09d0bd5a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:55.451533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.453505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1312986-7b5b-4937-adef-045cd5b6d746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.461539 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1024/2068] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:55 2022] DELETE /identity/v3/projects/21fe8961b31843ad8982e1c09d0bd5a1 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:55.464171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.464617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.465697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.498121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2389839-a2ba-475e-bcc5-f5c215749d33 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.531459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:55.533806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.596412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.597308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.597604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.597880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.599721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.623823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1025/2069] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:55.624846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:55.632093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.633877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.653969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a33f0-18d3-401a-95d4-af1208c818f0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.659915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.660585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.661165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.661294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] PATH_INFO: `/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.662474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e4b52e9543845e09aeb4bc7f86c2d8c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.665793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.690682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.693392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1f08e6-7269-4e59-b84f-3268e106d398 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.712700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1045/2070] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:55.723215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.723499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.723768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.734504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e4b52e9543845e09aeb4bc7f86c2d8c', 'request_id': 'req-681b5dc5-c4da-4476-96ce-52b142593d8b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.736613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:55.749654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e4b52e9543845e09aeb4bc7f86c2d8c', 'request_id': 'req-681b5dc5-c4da-4476-96ce-52b142593d8b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.761603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:55.763429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e4b52e9543845e09aeb4bc7f86c2d8c', 'request_id': 'req-681b5dc5-c4da-4476-96ce-52b142593d8b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.763603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.789973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] The token cache is being invalidate because project 6e4b52e9543845e09aeb4bc7f86c2d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:55.790425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.791494 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-681b5dc5-c4da-4476-96ce-52b142593d8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:55.793632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1026/2071] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:55 2022] DELETE /identity/v3/projects/6e4b52e9543845e09aeb4bc7f86c2d8c => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:55.799298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.799789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.800186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.825510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:55.828190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.872847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1046/2072] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:55.877247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.886886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac615338-8115-47d5-8c69-4a88c8114a08 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.897606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.898361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.898736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.899111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.899705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:55.900009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.901689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63fdb29-d2eb-4045-96d3-45dc1611f1a2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.932502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1047/2073] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:55.933641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1027/2074] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:55.937573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.938051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.938287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.943994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.958414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1524a4cc-59a5-4706-8e59-7b5388bdfee0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.961799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:55.963008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:55.964319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.965369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.965823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.966282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.966989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.972207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:55.973367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1048/2075] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:55.977534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:55.986937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c84413c-803d-46ea-b8da-13139248ab72 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:55.992654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:55.993512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:55.993862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:55.994107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:55.994899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:55.995269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:55.996969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.007904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1028/2076] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:55 2022] POST /identity/v3/projects => generated 371 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:56.015573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1049/2077] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:56.015739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.017300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.027898 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a64d696-82c8-4b34-ab90-f527ca780500 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.103321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cebd9c-6a76-420f-9f63-ffc375fda58d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.108955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.109737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.110020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.110295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.110963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.112895 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.117728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.118410 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.118760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.119105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.119808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.121831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.138697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1029/2078] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/users => generated 286 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:56.138697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.138697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.151173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f6ebba7-d74a-4e6e-9a7a-55f0ed598c36 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.157231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1050/2079] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/projects => generated 377 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:10:56.157231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.159404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.202630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.218424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.219209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.219586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.219958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] PATH_INFO: `/v3/projects/b49bba9b58864cf48c676cde6ea7853d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.221354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b49bba9b58864cf48c676cde6ea7853d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.221767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723cd02c-ded7-4a51-ae3c-ab1bb289a6e9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.223260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.226449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.227052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.227447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.227730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.228379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.230043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.239990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1051/2080] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:56.240849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.251972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72036ca6-36f5-41f7-939f-0c2428748423 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.257345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.257939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.258218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.258636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.259268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.261169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.270007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b49bba9b58864cf48c676cde6ea7853d', 'request_id': 'req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.279380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b49bba9b58864cf48c676cde6ea7853d', 'request_id': 'req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.282605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1052/2081] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/users => generated 289 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:56.283470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.285577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b49bba9b58864cf48c676cde6ea7853d', 'request_id': 'req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.293716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b11d40a-3cfe-4bbb-b442-d36ddd3f2afd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.300428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] The token cache is being invalidate because project b49bba9b58864cf48c676cde6ea7853d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:56.300866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.301771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.303414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1030/2082] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:56 2022] DELETE /identity/v3/projects/b49bba9b58864cf48c676cde6ea7853d => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:56.304323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.305721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.360987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.361655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.361940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.362250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.362904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.364545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.377217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1053/2083] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:56.377217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.377580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.383315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16bf6da-0c6c-42f3-ab5c-77536cdcb784 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.390429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae63c109-4654-4dcb-84b2-8d211b76c87f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.392270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.392885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.393164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.394350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.394350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.395158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.395773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.396057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.396338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] PATH_INFO: `/v3/users/1484450292ac43548e78c0c53dbc19dc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.396656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.397544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] RBAC: Authorizing `identity:delete_user(user_id=1484450292ac43548e78c0c53dbc19dc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.399445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.410071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1031/2084] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:56.410940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.412908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.427027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb50f619-f247-48bd-9588-a8d10cc579c2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.432335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.433097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.433420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.433668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] PATH_INFO: `/v3/projects/18186fc8d5ab4af8a6738ed55472a3ea/users/17a540de2ab94652922926c059f9ca8a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.453561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] RBAC: Authorizing `identity:create_grant(project_id=18186fc8d5ab4af8a6738ed55472a3ea, user_id=17a540de2ab94652922926c059f9ca8a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.453775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1484450292ac43548e78c0c53dbc19dc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.456658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.461853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1484450292ac43548e78c0c53dbc19dc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.470611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1484450292ac43548e78c0c53dbc19dc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.471591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1484450292ac43548e78c0c53dbc19dc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.472084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1032/2085] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:56 2022] PUT /identity/v3/projects/18186fc8d5ab4af8a6738ed55472a3ea/users/17a540de2ab94652922926c059f9ca8a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:56.475824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.477794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.479547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:INSERT=4,keystone:DELETE=9 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.487344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8bc4bcfc-552d-4a7a-93e5-bb2328d01b9b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1484450292ac43548e78c0c53dbc19dc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.493625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1054/2086] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:56 2022] DELETE /identity/v3/users/1484450292ac43548e78c0c53dbc19dc => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:56.494825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.495152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.495428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.516151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:56.518199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.532194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.559059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da22c936-8fa5-4273-b02d-9bd09692e31d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.593980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1055/2087] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:56.605704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.608968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.631067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.632394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.632739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.633073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.634055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.635601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.648682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1033/2088] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:56.654153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.671492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e813fa-3d51-4dad-8dd3-735917f8613d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.676564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.677279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.677580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.677963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] PATH_INFO: `/v3/projects/d7992008e9624c2f8b6049373f677c34/users/46bc34b88271484dbd43fb5c3c19fd7d/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.691094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b508df47-f04b-458b-9233-835f210dd5dd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.693429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.694067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.694442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.694809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.695650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7992008e9624c2f8b6049373f677c34, user_id=46bc34b88271484dbd43fb5c3c19fd7d, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.698916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.708174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.710090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a828ec-b453-4ccd-a68f-4e524514c222 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.716569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1034/2089] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:56 2022] PUT /identity/v3/projects/d7992008e9624c2f8b6049373f677c34/users/46bc34b88271484dbd43fb5c3c19fd7d/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:56.716569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.719156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.732121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1056/2090] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:56.733156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.734014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.734390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.767045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] MFA Rules not processed for user `46bc34b88271484dbd43fb5c3c19fd7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:56.768355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.821774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93457a95-b8a1-4f1a-9ec6-dec562cbd997 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.830403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.831112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.831637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.831975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] PATH_INFO: `/v3/users/d4a991c6c4b94937ab6488a31b129d56` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.833212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4a991c6c4b94937ab6488a31b129d56)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.835223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.844148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1057/2091] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:56.856091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:56.857746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.901733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4a991c6c4b94937ab6488a31b129d56'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.909464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.912432 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4a991c6c4b94937ab6488a31b129d56'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.931359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:56.935491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4a991c6c4b94937ab6488a31b129d56'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.936485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4a991c6c4b94937ab6488a31b129d56'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.948424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f4f49-2268-458b-8e0f-e08e5a7b6e47 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:56.956286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:56.956722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.956964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e5c17c82-6543-4f87-b824-be2a799a7ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4a991c6c4b94937ab6488a31b129d56'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:56.957120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.957296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.959894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:56.972136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1035/2092] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:10:56 2022] DELETE /identity/v3/users/d4a991c6c4b94937ab6488a31b129d56 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:56.974343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:56.974756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:56.975187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:56.975452 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:56.977060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:56.988690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1058/2093] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:10:57.001752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:57.003180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.057536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.059259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.084591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef82ea9f-750e-4726-903c-35c2b6f4d39f service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.149549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1036/2094] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:57.163580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.165006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.199169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.200155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.200492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.200778 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] PATH_INFO: `/v3/projects/e496d4e87a5e4d1eb254da837877ddf8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.202197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e496d4e87a5e4d1eb254da837877ddf8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.205414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.305796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e496d4e87a5e4d1eb254da837877ddf8', 'request_id': 'req-1220b63a-427f-4b70-ad0a-bb3b6d337b80'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:57.306614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e09675-e92b-4996-b941-a383da3b7e77 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.317254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e496d4e87a5e4d1eb254da837877ddf8', 'request_id': 'req-1220b63a-427f-4b70-ad0a-bb3b6d337b80'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:57.329834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e496d4e87a5e4d1eb254da837877ddf8', 'request_id': 'req-1220b63a-427f-4b70-ad0a-bb3b6d337b80'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:57.347082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] The token cache is being invalidate because project e496d4e87a5e4d1eb254da837877ddf8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:57.347564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:57.348450 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1220b63a-427f-4b70-ad0a-bb3b6d337b80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:57.351755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1059/2095] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:57 2022] DELETE /identity/v3/projects/e496d4e87a5e4d1eb254da837877ddf8 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:10:57.358009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e96f-5f9b-41c1-9894-115fc7a21a83 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.358009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e96f-5f9b-41c1-9894-115fc7a21a83 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.358009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8496e96f-5f9b-41c1-9894-115fc7a21a83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.387969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8496e96f-5f9b-41c1-9894-115fc7a21a83 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:57.390437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8496e96f-5f9b-41c1-9894-115fc7a21a83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.396658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.397464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.397821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.398358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.400225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.522110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:57.541596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:57.548886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1060/2096] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:57.550468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.550822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.551060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.551168 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.555268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.574913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:57.576294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:57.590609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1061/2097] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:57.592703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1037/2098] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:57.597562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.607267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e54bd4d-7531-449a-a84b-b861ba6f2627 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.627463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.628164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.628446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.628721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.630495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:57.630495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.631656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.656994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1062/2099] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:57.661364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.676658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0141be52-06fd-4240-a420-846ecf6bf294 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.684183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.685073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.685810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.685810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.686574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.689099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.723543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1038/2100] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:57 2022] POST /identity/v3/projects => generated 371 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:57.727246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.738211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0af41a-b694-4304-9c27-eaf2967ffb58 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.815961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.816749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.817111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.817522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.818257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.820270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.849670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1063/2101] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:57 2022] POST /identity/v3/users => generated 286 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:57.850669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.864187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12c6fb5-0678-4bd6-8d3e-fa7a2ae619ac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.870790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.871457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.871752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.877258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.878261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.880935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.901593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1039/2102] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:57.902909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.915051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020d18c6-fcc0-407a-96ae-44d6820d5b78 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.922240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.923079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.923961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.924370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:57.925504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:57.927540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb3dfd2-70e0-41bf-a907-08c316758095 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:57.949215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1064/2103] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:57 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:57.950869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:57.979324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91002ac5-b530-4594-9722-0bd0ef3dcbcc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:57.993203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:57.994433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:57.995123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:57.995559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] PATH_INFO: `/v3/projects/4f897efa130940b68518d721e8c9ef69/users/323b47371833408db370c4736f4725cc/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.021657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f897efa130940b68518d721e8c9ef69, user_id=323b47371833408db370c4736f4725cc, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.026847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2e742-e6fe-4433-aadf-6934d22662e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.031226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.031617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.031982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.055166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1040/2104] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:57 2022] PUT /identity/v3/projects/4f897efa130940b68518d721e8c9ef69/users/323b47371833408db370c4736f4725cc/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:58.063337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.063632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.063910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.112670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:58.113028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] MFA Rules not processed for user `17a540de2ab94652922926c059f9ca8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:58.113940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.114259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.217409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1065/2105] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:58.219425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.221664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.263679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1041/2106] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:58.264930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.268375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.289133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3a61c6-1628-41e9-877a-18a5feeb99c9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.300184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.302045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.302861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.302861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.303854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.305834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.370863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:58.375713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1042/2107] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/projects => generated 373 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:58.376752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.378844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.403587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dc367a-7a06-424d-b7aa-07234717d0e4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.480749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da6cec9-f1d3-4f52-885f-5e810fa0174d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.483161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.484142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.484580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.484941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] PATH_INFO: `/v3/projects/70a36d0f924b41f28d07ffd9c5570ebd` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.486177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] RBAC: Authorizing `identity:delete_project(project_id=70a36d0f924b41f28d07ffd9c5570ebd)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.486579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.487507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.488098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.488216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.488957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.504217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.505843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.520470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1043/2108] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:58.521379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.534350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02200795-ea13-47eb-8f20-627b16aaff58 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.551013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.551663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.551990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.552124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.552705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.554893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.576619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:58.577701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70a36d0f924b41f28d07ffd9c5570ebd', 'request_id': 'req-e19d95a8-a9ab-4cbb-af10-10a777333cea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:58.585716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1044/2109] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/users => generated 293 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:58.589503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.595601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70a36d0f924b41f28d07ffd9c5570ebd', 'request_id': 'req-e19d95a8-a9ab-4cbb-af10-10a777333cea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:58.601959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0122c3-137c-4164-a56a-f18ba33d28c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.604227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70a36d0f924b41f28d07ffd9c5570ebd', 'request_id': 'req-e19d95a8-a9ab-4cbb-af10-10a777333cea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:58.617947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] The token cache is being invalidate because project 70a36d0f924b41f28d07ffd9c5570ebd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:10:58.618200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:58.619210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e19d95a8-a9ab-4cbb-af10-10a777333cea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:10:58.621052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1066/2110] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:10:58 2022] DELETE /identity/v3/projects/70a36d0f924b41f28d07ffd9c5570ebd => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:58.628632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95b2d-737a-4572-94b0-b646e7e2d80e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.628772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95b2d-737a-4572-94b0-b646e7e2d80e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.629061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe95b2d-737a-4572-94b0-b646e7e2d80e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.652593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ffe95b2d-737a-4572-94b0-b646e7e2d80e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:58.654267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ffe95b2d-737a-4572-94b0-b646e7e2d80e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.700335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.701213 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.701509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.701785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.703799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.706786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.731022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1045/2111] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:58.737428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.742837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.768425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85994e71-88ce-4172-b60a-f33e02441ec4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:58.769565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1067/2112] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:58.774284 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:58.775635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.775778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.776074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] PATH_INFO: `/v3/projects/04dfb52259b04aecb283dda7a779c44f/users/a062a821fc444edbb51eae0986304034/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.777411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:58.777841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:58.779424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:58.800840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=04dfb52259b04aecb283dda7a779c44f, user_id=a062a821fc444edbb51eae0986304034, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:58.805620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:58.818783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:58.824216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:58.831027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1046/2113] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:58 2022] PUT /identity/v3/projects/04dfb52259b04aecb283dda7a779c44f/users/a062a821fc444edbb51eae0986304034/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:58.835960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:58.879059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:59.008212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1068/2114] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:10:59.009233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.010830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440f286-211d-4676-b298-c75479acdc5c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.023993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.024921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.025335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.025715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.026489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.028348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.037705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d70f4f6-43e0-4352-96a2-756af44a84e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.043302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1047/2115] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:58 2022] GET /identity/v3/roles => generated 1420 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:59.046858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.047534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.048187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.049067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.049571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.050458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:10:59.051081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.053766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.063334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc301f0-be90-44d0-9a1a-375e9bd066cc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.070007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.070872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.071220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.071568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] PATH_INFO: `/v3/projects/04dfb52259b04aecb283dda7a779c44f/users/a062a821fc444edbb51eae0986304034/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.079163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1069/2116] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:10:59.079527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=04dfb52259b04aecb283dda7a779c44f, user_id=a062a821fc444edbb51eae0986304034, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.079527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.080650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.097644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fdcaa0-9d8c-4d3d-9276-99e19e7ed5fe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.101680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1048/2117] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:59 2022] PUT /identity/v3/projects/04dfb52259b04aecb283dda7a779c44f/users/a062a821fc444edbb51eae0986304034/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:59.207268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.209369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.209758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.210108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.210865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.213842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.255741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1070/2118] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:10:59 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:59.260444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.276854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3877-8316-4f2c-9ed5-16082c0a20e6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.394273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:59.407240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.408006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.408544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.408707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.409469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.414104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.447223 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1049/2119] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:10:59 2022] POST /identity/v3/users => generated 292 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:10:59.451684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.461998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff7908f-5425-4081-9c3d-a86b774ac382 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.466799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.468009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.468368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.468713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.469460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.471484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.486629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1071/2120] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:10:59.490501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.501209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc0ad9b-8fe6-49c6-979c-269c06f154f3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.506242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.507118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.507503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.507879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.513595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.515497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f6a5b6-6f65-4ea8-a083-a4fa12ace401 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.527403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1050/2121] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:10:59 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:10:59.532548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.545371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5eef-8901-485a-89ba-29cb8a7286eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.552716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.560132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.561002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.563294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] PATH_INFO: `/v3/projects/24924e0862684d4787a5d3f932907651/users/62d11a74dcb3419eb119f8771bfc9cf6/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.583101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] RBAC: Authorizing `identity:create_grant(project_id=24924e0862684d4787a5d3f932907651, user_id=62d11a74dcb3419eb119f8771bfc9cf6, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.586238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e03568-988c-4b42-82ee-6f86bd6d9387 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.600706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.601296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.601397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.618962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1072/2122] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:10:59 2022] PUT /identity/v3/projects/24924e0862684d4787a5d3f932907651/users/62d11a74dcb3419eb119f8771bfc9cf6/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:10:59.621148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.621660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.622105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.640303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] MFA Rules not processed for user `323b47371833408db370c4736f4725cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:59.641904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:59.649046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:10:59.650707 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:59.716642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:10:59.732834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1073/2123] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:59.743179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1051/2124] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:10:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:10:59.744434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.746363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:59.752010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:10:59.753552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:10:59.814794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e258d68b-36d3-419a-a1bf-21df151a17dd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.819080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.819699 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.820293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.820293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.838951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.840870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f262e39-005c-47a9-aab2-4d2677bc9c41 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.842118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcaf214-7ffe-48ef-8d1f-a5f9414a72f5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:10:59.851076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:10:59.851764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:10:59.852054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:10:59.853502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:10:59.855365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1074/2125] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:10:59.866834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:10:59.868469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4b4271-0d57-46e1-9bc6-c4feb9536bf0 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:10:59.880793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1052/2126] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:10:59 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:11:01.074264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:01.074744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:01.074744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:01.115646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] MFA Rules not processed for user `a062a821fc444edbb51eae0986304034`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:01.116935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:01.221818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1075/2127] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:01.232874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401faa7-bb53-47c6-b658-961acdee12a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:01.234598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401faa7-bb53-47c6-b658-961acdee12a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:01.235392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e401faa7-bb53-47c6-b658-961acdee12a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:01.266293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e401faa7-bb53-47c6-b658-961acdee12a6 None None] MFA Rules not processed for user `17a540de2ab94652922926c059f9ca8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:01.268264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e401faa7-bb53-47c6-b658-961acdee12a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:01.381823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1053/2128] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:01.394657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:01.396246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:01.569299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3701e6-1c35-4020-8400-14d1c69d87f7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:01.587043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:01.587810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:01.588085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:01.588362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:01.591730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:01.616751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:01.621295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970675c9-91ee-4a7f-adff-d38d972c14b2 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:01.660680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85aa28-03f7-4ccd-b369-f645c201e7d6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:01.661574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85aa28-03f7-4ccd-b369-f645c201e7d6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:01.662232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c85aa28-03f7-4ccd-b369-f645c201e7d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:01.664310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1076/2129] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:01 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:01.727218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3c85aa28-03f7-4ccd-b369-f645c201e7d6 None None] MFA Rules not processed for user `323b47371833408db370c4736f4725cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:01.729132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3c85aa28-03f7-4ccd-b369-f645c201e7d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:01.744430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1054/2130] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:11:04.147703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:04.148243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:04.148358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:04.149992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1077/2131] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:11:04.161887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:04.162513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:04.162513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:04.176773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:04.205682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:04.207240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:04.275428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:04.278082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:04.304028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670fbb92-076e-4f63-8bd6-0b3af0f01429 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:04.321753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:04.323139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:04.323651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:04.324145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] PATH_INFO: `/v3/users/21b1739c7e9945639af536a9652a49e7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:04.326153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21b1739c7e9945639af536a9652a49e7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:04.330798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:04.339337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:04.363956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1055/2132] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:11:04 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:04.382736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:04.384807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:04.409901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef1b6cd-ab17-4258-867e-50873510d3b9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:04.428130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:04.429459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:04.430510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:04.430987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:04.439140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21b1739c7e9945639af536a9652a49e7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:04.443805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:04.447202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:04.457908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21b1739c7e9945639af536a9652a49e7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:04.472216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1056/2133] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:04 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:11:04.482461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21b1739c7e9945639af536a9652a49e7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:04.483416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21b1739c7e9945639af536a9652a49e7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:04.511481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-41580460-e87f-4024-b685-dfc61a4b2637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21b1739c7e9945639af536a9652a49e7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:04.550092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1078/2134] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:04 2022] DELETE /identity/v3/users/21b1739c7e9945639af536a9652a49e7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:05.153803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:05.168528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c761b36c-1b17-4315-b581-1616196e0377 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:05.256975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:05.258015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.258426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.258960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] PATH_INFO: `/v3/projects/524a60b89cb04ec2bef9d0208d390e85` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.260491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] RBAC: Authorizing `identity:delete_project(project_id=524a60b89cb04ec2bef9d0208d390e85)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:05.265070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:05.323514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '524a60b89cb04ec2bef9d0208d390e85', 'request_id': 'req-170684ee-59db-4643-9d87-886586136a27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:05.336301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '524a60b89cb04ec2bef9d0208d390e85', 'request_id': 'req-170684ee-59db-4643-9d87-886586136a27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:05.349069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '524a60b89cb04ec2bef9d0208d390e85', 'request_id': 'req-170684ee-59db-4643-9d87-886586136a27'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:05.380118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] The token cache is being invalidate because project 524a60b89cb04ec2bef9d0208d390e85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:05.380588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:05.381503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-170684ee-59db-4643-9d87-886586136a27 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:05.383096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1057/2135] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:05 2022] DELETE /identity/v3/projects/524a60b89cb04ec2bef9d0208d390e85 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:05.388136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.388631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.388728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.428275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:05.429521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:05.517664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1079/2136] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:05.525549 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.525980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.526490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.547855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:05.549335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:05.557381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1058/2137] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:05.561725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:05.572381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b12e69-dc8f-44d7-9dcf-9ff606ed90f7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:05.578509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:05.579411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.579853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.580196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.581013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:05.581416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:05.583237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:05.602671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1080/2138] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:05.604274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:05.615314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441cdb0-0f36-48a4-9f0f-74124db7e01c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:05.620420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:05.621033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.621354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.621632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.622278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:05.625422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:05.639195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:05.700807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1059/2139] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:05 2022] POST /identity/v3/projects => generated 369 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:05.705693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:05.734370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c43e8b-ad71-42c3-998a-0d52db7ebf69 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:05.890639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:05.891542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:05.891973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:05.892370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:05.893227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:05.897038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:05.981643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1081/2140] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:05 2022] POST /identity/v3/users => generated 285 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:05.986090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.001393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083a4bc5-137d-453f-82e2-61c0b27efe17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.036455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.037755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.038416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.039505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.040942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.052614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.101409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1060/2141] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:05 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:06.103091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.108872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:06.117284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf38502f-e639-4eb7-b75c-b0189d76d8f4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.129929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.132422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.133434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.134742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.135612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.138418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cadd25-4934-42eb-a73d-7ec6ec98e015 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.168889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1082/2142] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:06.170296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.189903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f850c9bd-54ac-4729-b3f4-c7d61d357d5c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.222265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.224139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.226594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.226974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] PATH_INFO: `/v3/projects/7ddc82044f9e4696ad0326652e579c94/users/702ecea1fd634f09a9821d85265e6116/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.296546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ddc82044f9e4696ad0326652e579c94, user_id=702ecea1fd634f09a9821d85265e6116, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.319940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.346181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1061/2143] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:06 2022] PUT /identity/v3/projects/7ddc82044f9e4696ad0326652e579c94/users/702ecea1fd634f09a9821d85265e6116/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:06.357010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.357521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.357640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.428195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] MFA Rules not processed for user `702ecea1fd634f09a9821d85265e6116`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:06.434567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:06.624509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1083/2144] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:06.627711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.743361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b4be46d-747f-449b-8500-01b123e8d961 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.749838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.750540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.750866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.751123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.751790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.758032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.813380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1062/2145] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:06 2022] POST /identity/v3/projects => generated 367 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:06.816009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:06.830986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8fa8e7-d18b-4668-9c0f-604bdcf02692 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:06.936104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:06.936925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:06.937361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:06.937727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:06.938562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:06.941044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:06.990192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1084/2146] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:06 2022] POST /identity/v3/users => generated 290 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:06.993935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.010770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4545c-464d-4573-a819-e77821675190 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.021818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.022802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.023085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.023419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.024078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.025900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.041765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1063/2147] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:11:07.043491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.064500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10f338-fa93-4af7-a207-0798526eacfa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.077599 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.079292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.081147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.082062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] PATH_INFO: `/v3/projects/08617ad69a4142ad9af4f2af64e73fed/users/e598b13f8f354195b7cf3eac7b8ac5bf/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.119010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08617ad69a4142ad9af4f2af64e73fed, user_id=e598b13f8f354195b7cf3eac7b8ac5bf, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.123239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.151405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1085/2148] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:07 2022] PUT /identity/v3/projects/08617ad69a4142ad9af4f2af64e73fed/users/e598b13f8f354195b7cf3eac7b8ac5bf/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:07.153052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.164128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2bd474-7ac5-47df-8fad-869d24cd468d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.267781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.268621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.269440 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.269796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.270686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.272444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8ecc12-f5ad-48b1-b61a-b423ac925a6b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.289585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.290830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1064/2149] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:07 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:11:07.307217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3434b-49ad-4def-bb28-233492981646 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.314887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.315501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.315827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.316105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] PATH_INFO: `/v3/projects/08617ad69a4142ad9af4f2af64e73fed/users/e598b13f8f354195b7cf3eac7b8ac5bf/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.318362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08617ad69a4142ad9af4f2af64e73fed, user_id=e598b13f8f354195b7cf3eac7b8ac5bf, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.321303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.338849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1086/2150] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:07 2022] PUT /identity/v3/projects/08617ad69a4142ad9af4f2af64e73fed/users/e598b13f8f354195b7cf3eac7b8ac5bf/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:11:07.351982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.352444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.352871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.394646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] MFA Rules not processed for user `e598b13f8f354195b7cf3eac7b8ac5bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:07.396166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:07.409755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:07.487720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1065/2151] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:07 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:07.495630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.497629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:07.580584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:07.616116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeac4766-f62e-4317-a860-826e3eeb65e4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.627188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.627837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.628118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.628559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.646644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.650139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e40865-162e-4cd0-a598-36b895111d18 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.680043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1087/2152] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:07.777888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:07.793368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b0dc9e-e347-4592-8da8-424b76a5b686 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:07.800817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:07.801688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:07.802708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:07.802708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:07.909209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:07.911227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:07.945294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1066/2153] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:07 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:08.094453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.094724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.095043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.156845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] MFA Rules not processed for user `62d11a74dcb3419eb119f8771bfc9cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:08.158294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:08.266041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1088/2154] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:08.271406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.273471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:08.442910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b27194c-cc4e-45b6-8f24-d1f190209ff4 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.449425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.451363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.452852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.453329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.454607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.458370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.521592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1067/2155] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:08 2022] POST /identity/v3/projects => generated 383 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:08.523030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.543407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7974f-f6a8-4cef-81b4-6bb18b095298 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.645148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.646211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.646694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.647166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.648027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.650870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.679793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1089/2156] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:08 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:08.683757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.711041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ec8930-d570-43b8-80b4-20a09010c0fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.727531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.728805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.729597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.730379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.732065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.734684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.750491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1068/2157] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:08.751400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.765251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8804c7b-4eca-44a5-839a-2c5d79d0efbb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.770009 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.770687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.771639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.771919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] PATH_INFO: `/v3/projects/c448d57f3a8243bbbfa8442c2559e33f/users/3444b6b8c75c4465842d3333244dd6ce/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.790929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c448d57f3a8243bbbfa8442c2559e33f, user_id=3444b6b8c75c4465842d3333244dd6ce, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.794243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.823321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1090/2158] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:08 2022] PUT /identity/v3/projects/c448d57f3a8243bbbfa8442c2559e33f/users/3444b6b8c75c4465842d3333244dd6ce/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:08.827433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.847669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11289e8-6363-4b3d-8e1a-4a0f2d49f930 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.872973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:08.918679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.919645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.919645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.920062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.921513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.924756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.943128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1069/2159] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:08 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:08.947129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:08.959125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61e8e5-8846-43bc-9e2c-3c1936929c10 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:08.964456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:08.965288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:08.965683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:08.966217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] PATH_INFO: `/v3/projects/c448d57f3a8243bbbfa8442c2559e33f/users/3444b6b8c75c4465842d3333244dd6ce/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:08.969651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c448d57f3a8243bbbfa8442c2559e33f, user_id=3444b6b8c75c4465842d3333244dd6ce, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:08.972668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b59c141-cf8e-4fb1-8978-c0cb47aea6d1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:08.984558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1091/2160] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:08 2022] PUT /identity/v3/projects/c448d57f3a8243bbbfa8442c2559e33f/users/3444b6b8c75c4465842d3333244dd6ce/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:11:10.836100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:10.838086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:10.859699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0cba8-25d9-4560-92e5-f8728bee63fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:10.995601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:10.996376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:10.996663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:10.996945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] PATH_INFO: `/v3/users/46bc34b88271484dbd43fb5c3c19fd7d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:10.998611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46bc34b88271484dbd43fb5c3c19fd7d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:11.001042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:11.148817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46bc34b88271484dbd43fb5c3c19fd7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:11.160053 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46bc34b88271484dbd43fb5c3c19fd7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:11.174862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46bc34b88271484dbd43fb5c3c19fd7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:11.176017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46bc34b88271484dbd43fb5c3c19fd7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:11.189921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46bc34b88271484dbd43fb5c3c19fd7d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:11.204165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1070/2161] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:10 2022] DELETE /identity/v3/users/46bc34b88271484dbd43fb5c3c19fd7d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:11.208708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:11.209224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:11.209359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:11.241723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:11.243214 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:11.266377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:11.419047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1092/2162] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:11.443625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:11.445448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:11.622933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:11.651848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bef873-a98f-4a6e-8df1-df6f504169b2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:11.665466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:11.666030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:11.666308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:11.666725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:11.694427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:11.697953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a1437f-fc5b-477b-9d1f-9688330d620d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:11.730290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1071/2163] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:12.418903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.423185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:12.462787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b257375e-8c44-42d8-9494-f99fb0291dce None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:12.485603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:12.486288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.486568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.486836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] PATH_INFO: `/v3/users/702ecea1fd634f09a9821d85265e6116` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:12.489851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] RBAC: Authorizing `identity:delete_user(user_id=702ecea1fd634f09a9821d85265e6116)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:12.491769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:12.581582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702ecea1fd634f09a9821d85265e6116'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:12.597025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702ecea1fd634f09a9821d85265e6116'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:12.619502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702ecea1fd634f09a9821d85265e6116'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:12.620451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702ecea1fd634f09a9821d85265e6116'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:12.647729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702ecea1fd634f09a9821d85265e6116'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:12.659217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1093/2164] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:12 2022] DELETE /identity/v3/users/702ecea1fd634f09a9821d85265e6116 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:12.663542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.664099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.664334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:12.697020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:12.699366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:12.715384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.719605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:12.841821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1072/2165] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:12.863790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:12.865794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:12.905854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177aee02-fdcc-49aa-828f-74eebb812c25 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:12.921043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:12.921899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.922179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.922455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] PATH_INFO: `/v3/projects/d7992008e9624c2f8b6049373f677c34` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:12.928002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7992008e9624c2f8b6049373f677c34)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:12.930363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:12.971063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a1bce-00ef-4764-ae79-aee14d9608b0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:12.975615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:12.976484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:12.976835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:12.977201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.014317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.016535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294c684a-121e-4b9d-bbd4-049008a141ea service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.024460 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:13.034308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1073/2166] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:13.048560 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7992008e9624c2f8b6049373f677c34', 'request_id': 'req-9cd430ec-1e24-4580-acc9-1aafe582ae5d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.058472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7992008e9624c2f8b6049373f677c34', 'request_id': 'req-9cd430ec-1e24-4580-acc9-1aafe582ae5d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.065957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7992008e9624c2f8b6049373f677c34', 'request_id': 'req-9cd430ec-1e24-4580-acc9-1aafe582ae5d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.085136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] The token cache is being invalidate because project d7992008e9624c2f8b6049373f677c34 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:13.085136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.085956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9cd430ec-1e24-4580-acc9-1aafe582ae5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.089273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1094/2167] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:12 2022] DELETE /identity/v3/projects/d7992008e9624c2f8b6049373f677c34 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:13.095038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.095411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.096051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.119787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:13.121503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:13.217698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1074/2168] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:13.225981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.226313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.226595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.261033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:13.265229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:13.279809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.286833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1095/2169] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:13.291752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31fe042-183e-42bc-9d8e-468c9f49977c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.331036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.331693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.331977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.332262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.332939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:13.333275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.346907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.385160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.397644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1075/2170] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:13.400820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942316a1-018c-40df-80d5-e4a4f34213ac None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.429839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.432784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.433081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.435500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.437424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.441079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.515680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.517582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:13.525794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1096/2171] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:13 2022] POST /identity/v3/projects => generated 381 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:13.527098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.558087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b6eca9-2d6b-4a34-a029-40ce2e90a65d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.586854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:13.637073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8893de64-3424-44fc-aac2-51cfb9f7ff6f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.644440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.646161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.646736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.647245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.648650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.658644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.697911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.699554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.699839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.700211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] PATH_INFO: `/v3/projects/7ddc82044f9e4696ad0326652e579c94` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.702057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ddc82044f9e4696ad0326652e579c94)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.704765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.713637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1097/2172] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:13 2022] POST /identity/v3/users => generated 291 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:13.715164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.739693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3214bdc-65d5-41c0-8bd9-4f8e8a45fcdc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.752634 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.753222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.753515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.755678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.756451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.760238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.789215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1098/2173] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:13.793838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.808260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a39137-ab5d-4962-8a17-2a9afe903ae1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:13.816251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ddc82044f9e4696ad0326652e579c94', 'request_id': 'req-f2e09930-0995-456b-86b4-893668ba85a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.829044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ddc82044f9e4696ad0326652e579c94', 'request_id': 'req-f2e09930-0995-456b-86b4-893668ba85a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.840378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ddc82044f9e4696ad0326652e579c94', 'request_id': 'req-f2e09930-0995-456b-86b4-893668ba85a2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.867472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] The token cache is being invalidate because project 7ddc82044f9e4696ad0326652e579c94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:13.867738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.868581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:13.870505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1076/2174] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:13 2022] DELETE /identity/v3/projects/7ddc82044f9e4696ad0326652e579c94 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:13.882516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.885056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:13.905334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:13.906731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:13.906829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:13.907061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:13.907737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:13.910058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:13.951540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1099/2175] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:13 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:11:13.956308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:13.957873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:13.993532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbb7b27-aa47-4c90-81c0-6bb4bee8f57e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:14.005565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e09930-0995-456b-86b4-893668ba85a2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:14.011383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:14.011966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:14.012226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:14.012515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:14.012969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] PATH_INFO: `/v3/users/e598b13f8f354195b7cf3eac7b8ac5bf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:14.013347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:14.014654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:14.014971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e598b13f8f354195b7cf3eac7b8ac5bf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:14.015235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] PATH_INFO: `/v3/projects/581456a86daa411a89d2b3615058795a/users/84319a43674146d2899cd238f101d471/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:14.017293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:14.019278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:14.052007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=581456a86daa411a89d2b3615058795a, user_id=84319a43674146d2899cd238f101d471, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:14.056382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4aa86ab-bc11-46b2-b2a7-acf76dfc24ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:14.082078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1100/2176] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:13 2022] PUT /identity/v3/projects/581456a86daa411a89d2b3615058795a/users/84319a43674146d2899cd238f101d471/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:14.094618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:14.095271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:14.098150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:14.130214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:14.134155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e598b13f8f354195b7cf3eac7b8ac5bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:14.147372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e598b13f8f354195b7cf3eac7b8ac5bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:14.151262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] MFA Rules not processed for user `84319a43674146d2899cd238f101d471`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:14.155483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:14.176228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e598b13f8f354195b7cf3eac7b8ac5bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:14.177089 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e598b13f8f354195b7cf3eac7b8ac5bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:14.202424 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e598b13f8f354195b7cf3eac7b8ac5bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:14.225338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1077/2177] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:13 2022] DELETE /identity/v3/users/e598b13f8f354195b7cf3eac7b8ac5bf => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:14.284875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1101/2178] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:14 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:14.297787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:14.299578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:14.404498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cef1d9c-bbf9-4ed8-92b6-0eb7a68b9ba7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:14.409145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:14.409797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:14.410079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:14.410350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:14.483438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:14.484301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cf2a50-cc00-4e97-a130-0f3820723b43 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:14.494561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1078/2179] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:14 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:14.900735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:14.902290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:15.021912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d1aa2a-e7a1-4bf6-a537-6b8f6a84b24b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.153135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.153823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.154109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.155106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] PATH_INFO: `/v3/projects/08617ad69a4142ad9af4f2af64e73fed` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.156434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=08617ad69a4142ad9af4f2af64e73fed)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.158844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.211910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:15.252571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08617ad69a4142ad9af4f2af64e73fed', 'request_id': 'req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:15.268616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08617ad69a4142ad9af4f2af64e73fed', 'request_id': 'req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:15.275722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08617ad69a4142ad9af4f2af64e73fed', 'request_id': 'req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:15.289865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] The token cache is being invalidate because project 08617ad69a4142ad9af4f2af64e73fed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:15.290202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:15.292111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-89caf9af-29ed-40ff-8cc8-fe57bab7a9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:15.297615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1102/2180] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:14 2022] DELETE /identity/v3/projects/08617ad69a4142ad9af4f2af64e73fed => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:15.300295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.300295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.300295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.329675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:15.331126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:15.431809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1079/2181] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:15.440219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.440700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.441067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.466686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:15.468480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:15.478573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1103/2182] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:15.486515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:15.501614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7512cb9e-748b-44f5-9cdd-bf472d84a467 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.507768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.508628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.509062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.509421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.510625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:15.510808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.512437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.546243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1080/2183] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:15.547292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:15.557117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054cfd96-8641-4cd6-9007-d8ab4223e62f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.562879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.563614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.563965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.564346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.565002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.567085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.604012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1104/2184] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:15 2022] POST /identity/v3/projects => generated 379 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:15.608030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:15.613664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:15.624853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc6d98-1d96-4a3b-9e7f-606abdf09b7d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.777439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.778349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.780128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.780534 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.781385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.792635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.855757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1081/2185] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:15 2022] POST /identity/v3/users => generated 290 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:15.869486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:15.871457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe68e4e-596d-4b26-b481-ac9f9761e525 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.885082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.886089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.886574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.887083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.887942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.890245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.907799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1105/2186] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:15.913323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:15.935453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5317d5b-bec5-4815-b12e-d674925794c2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:15.949356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:15.950218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:15.950218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:15.950521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:15.950916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:15.958855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9e7ba8-5606-46d7-be70-8e1704a2796e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:15.993233 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1082/2187] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:15 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:15.994807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.007540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a573cab-714a-4e3a-b822-f859823b513b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.025448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.026384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.026875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.027348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] PATH_INFO: `/v3/projects/e9c0f6f48bb747fcadc322e4121f5da3/users/5956e5f2ad7646b6bcad6f8649d30118/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.075007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9c0f6f48bb747fcadc322e4121f5da3, user_id=5956e5f2ad7646b6bcad6f8649d30118, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.081956 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.109286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1106/2188] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:15 2022] PUT /identity/v3/projects/e9c0f6f48bb747fcadc322e4121f5da3/users/5956e5f2ad7646b6bcad6f8649d30118/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:16.114304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.114658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.115007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.158217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] MFA Rules not processed for user `5956e5f2ad7646b6bcad6f8649d30118`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:16.159847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:16.273562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1083/2189] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:16.277374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.387965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67fe24-bf1b-4cd5-9f63-9bdd305b9284 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.406703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.407479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.407842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.408186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.409025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.413144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.461096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1107/2190] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:16 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:16.466087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.481209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de5a165-4dc3-455f-89e9-c04ac2fd47be None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.558045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.558939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.559257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.559701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.560463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.563975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.586899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:16.597931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1084/2191] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:16 2022] POST /identity/v3/users => generated 295 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:16.599064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.612924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b510011-4808-4ee9-9639-5b7c3574a480 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.618324 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.619012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.619328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.619612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.620621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.622518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.637720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1108/2192] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:16.642798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.667371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e019f395-fbd6-45e8-a2c3-682095c7907c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.673816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.674505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.674787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.675063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] PATH_INFO: `/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0/users/9526a1aae4004f309ca94ff9f50690c3/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.697106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bb9cf2b51b4f1d94ea451ca0ecd1a0, user_id=9526a1aae4004f309ca94ff9f50690c3, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.702674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.737903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1085/2193] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:16 2022] PUT /identity/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0/users/9526a1aae4004f309ca94ff9f50690c3/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:16.741877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.758414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783385c2-ff6a-4d8f-9ee4-d1b58b144e42 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.784221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:16.846691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.854576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.854982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.860825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.861781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.864704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e14e9d2b-dbd9-40f2-a2a9-b5b4f226507b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.892692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1109/2194] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:16 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:11:16.896775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:16.911802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb64798-4cb5-4f71-931a-6b23fef92540 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:16.928738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:16.929827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.930308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.930781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] PATH_INFO: `/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0/users/9526a1aae4004f309ca94ff9f50690c3/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:16.940878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=22bb9cf2b51b4f1d94ea451ca0ecd1a0, user_id=9526a1aae4004f309ca94ff9f50690c3, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:16.954660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c442d02f-43f3-4640-96c1-d17f8f8b7299 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:16.976852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1086/2195] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:16 2022] PUT /identity/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0/users/9526a1aae4004f309ca94ff9f50690c3/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:16.988087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:16.988639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:16.988639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.035757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] MFA Rules not processed for user `9526a1aae4004f309ca94ff9f50690c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:17.038035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.068379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.069085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.069427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.127398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] MFA Rules not processed for user `3444b6b8c75c4465842d3333244dd6ce`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:17.128833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.167418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1110/2196] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:16 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:17.180744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.182790 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.237063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1087/2197] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:17.249951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.251333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.259127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e663d0bf-1c8e-48bf-bda3-101f392de999 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.263199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.264487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.264765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.265317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.342294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:17.346730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.349317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.368101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1111/2198] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:17.381711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba5d047-c35d-476b-96ac-718b316ba345 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.386065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.387054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.387202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.387565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.389637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.446953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:17.473793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.478737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c48a72-5d5a-44c3-a56c-012988779d48 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.493771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1088/2199] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:17.564916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:17.566674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.773117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e62e05a1-f60e-4ef0-ba8a-8b6f6d237f3c service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:17.782951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:17.783887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.784177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.784514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] PATH_INFO: `/v3/users/84319a43674146d2899cd238f101d471` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.785983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84319a43674146d2899cd238f101d471)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:17.788002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:17.789297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbbff-c467-45a0-9d1c-07a15d8defef None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:17.789806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbbff-c467-45a0-9d1c-07a15d8defef None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:17.790312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27fbbff-c467-45a0-9d1c-07a15d8defef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:17.824326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f27fbbff-c467-45a0-9d1c-07a15d8defef None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:17.825599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f27fbbff-c467-45a0-9d1c-07a15d8defef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:17.871636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84319a43674146d2899cd238f101d471'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:17.894054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84319a43674146d2899cd238f101d471'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:17.908209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84319a43674146d2899cd238f101d471'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:17.908769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84319a43674146d2899cd238f101d471'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:17.977077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84319a43674146d2899cd238f101d471'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:17.991271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1089/2200] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:11:17.996064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1112/2201] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:17 2022] DELETE /identity/v3/users/84319a43674146d2899cd238f101d471 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:18.001463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.007102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.007413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.051237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:18.052480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:18.058791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.073801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:18.151882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1090/2202] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:18.160663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.165618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:18.222541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff27980c-28f2-4f84-9c60-48dcfbb89680 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.238917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.238917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.238917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.238917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.265077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:18.270070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e20e95-5da7-4afa-9de2-dfa981f4e942 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.275655 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.276287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.277127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.278222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.291373 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.293880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.307722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1091/2203] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:18.330678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.332478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4796ab35-e382-4b17-89fb-3d8406f91f2d service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:18.345654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1113/2204] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:11:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:18.887566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:18.890250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:18.929453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63281c51-d970-4361-a048-ffdc39a5186b service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:18.940767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:18.941522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:18.941863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:18.942209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] PATH_INFO: `/v3/projects/581456a86daa411a89d2b3615058795a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:18.944286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] RBAC: Authorizing `identity:delete_project(project_id=581456a86daa411a89d2b3615058795a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:18.946588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.051866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:19.097299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '581456a86daa411a89d2b3615058795a', 'request_id': 'req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:19.114551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '581456a86daa411a89d2b3615058795a', 'request_id': 'req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:19.141633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '581456a86daa411a89d2b3615058795a', 'request_id': 'req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:19.174797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] The token cache is being invalidate because project 581456a86daa411a89d2b3615058795a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:19.175254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:19.176079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:19.178650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1092/2205] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:18 2022] DELETE /identity/v3/projects/581456a86daa411a89d2b3615058795a => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:19.184096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa8b8b-c9e1-44c8-ac61-87bf4265cb4d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.184583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa8b8b-c9e1-44c8-ac61-87bf4265cb4d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.184880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa8b8b-c9e1-44c8-ac61-87bf4265cb4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.189979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.200626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:19.281540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-18fa8b8b-c9e1-44c8-ac61-87bf4265cb4d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:19.285789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-18fa8b8b-c9e1-44c8-ac61-87bf4265cb4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:19.368726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc0d191-d3f4-40e5-9476-c0bcd08d1140 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:19.386098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:19.386740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.387021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.387296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.392848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:19.475304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1114/2206] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:19.479836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.480140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.480415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.553094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:19.556417 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:19.582469 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1115/2207] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:19.595908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.611618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:19.612986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b79f0d2-2c5f-4968-94d5-c0fd8807fe2e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:19.613340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.625577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:19.627189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.629934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.630380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.630523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1093/2208] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:19.631353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:19.631811 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:19.635932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.672060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1116/2209] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:19.676999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.733541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9aec24-ae32-4671-9827-7b6f1c503b0d service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:19.804018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:19.805009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:19.805484 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:19.805771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:19.806730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:19.808765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:19.895880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1094/2210] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:19 2022] POST /identity/v3/projects => generated 375 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:19.899453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:19.920754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e24748-4714-4569-ae9f-2a6417bda667 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:20.127493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:20.128224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.128588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.128951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.129688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:20.131904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:20.166398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1117/2211] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:19 2022] POST /identity/v3/users => generated 288 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:20.167482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:20.180747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795b713b-dbc0-409c-a7a3-7c2f8836f1c1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:20.195875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:20.196634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.196988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.197351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.198095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:20.200772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:20.222889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1095/2212] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:20.236365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:20.246444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a5ce0-34e8-49ff-8c7b-c1b6f9daec28 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:20.253521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:20.254267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.254557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.255449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.256421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:20.260484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96bcc4b-a340-40a7-a7ad-c50ac095b448 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:20.273776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1118/2213] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:20.277612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:20.295475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a3b2ee-8d3c-4ef7-9107-ebfb0879a480 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:20.301979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:20.303342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.303625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.303978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] PATH_INFO: `/v3/projects/cc98eb70df124fe583f96ca80cc93c7c/users/a347090d79504bd5bac18c1290d3a95a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.322804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cc98eb70df124fe583f96ca80cc93c7c, user_id=a347090d79504bd5bac18c1290d3a95a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:20.325666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:20.350700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1096/2214] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:20 2022] PUT /identity/v3/projects/cc98eb70df124fe583f96ca80cc93c7c/users/a347090d79504bd5bac18c1290d3a95a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:11:20.363913 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6078-d5c4-47a8-a9fd-5d79a6334de6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.364526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6078-d5c4-47a8-a9fd-5d79a6334de6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.364985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906c6078-d5c4-47a8-a9fd-5d79a6334de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.404827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-906c6078-d5c4-47a8-a9fd-5d79a6334de6 None None] MFA Rules not processed for user `a347090d79504bd5bac18c1290d3a95a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:20.406429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-906c6078-d5c4-47a8-a9fd-5d79a6334de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:20.410738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:20.489106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1119/2215] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:20 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:11:20.502090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:20.504060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:20.515276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:20.581009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3958b9a-0f7a-4b79-a9a3-6446eaf56518 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:20.585111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:20.586344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:20.586344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:20.586520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:20.604101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:20.605761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:20.616885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1097/2216] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:20 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:22.180569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48c1b-7d1b-4ab5-934d-164f986cdb43 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:22.181137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48c1b-7d1b-4ab5-934d-164f986cdb43 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:22.181847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a48c1b-7d1b-4ab5-934d-164f986cdb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:22.202153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-18a48c1b-7d1b-4ab5-934d-164f986cdb43 None None] MFA Rules not processed for user `a347090d79504bd5bac18c1290d3a95a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:22.203483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-18a48c1b-7d1b-4ab5-934d-164f986cdb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:22.214041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1120/2217] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:22 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:24.190645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:24.192609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:24.293611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51eefdb-a6bc-434c-9657-78928f7e76ea service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:24.299924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:24.300928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.301317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.301723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] PATH_INFO: `/v3/users/5956e5f2ad7646b6bcad6f8649d30118` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.303480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5956e5f2ad7646b6bcad6f8649d30118)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:24.305718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.413789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5956e5f2ad7646b6bcad6f8649d30118'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:24.432633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5956e5f2ad7646b6bcad6f8649d30118'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:24.448585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5956e5f2ad7646b6bcad6f8649d30118'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:24.450298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5956e5f2ad7646b6bcad6f8649d30118'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:24.463475 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5956e5f2ad7646b6bcad6f8649d30118'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:24.491963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1098/2218] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:24 2022] DELETE /identity/v3/users/5956e5f2ad7646b6bcad6f8649d30118 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:24.496157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.497131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.497628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.526824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:24.529609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:24.645126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1121/2219] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:24.655347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:24.657025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:24.696067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:24.734064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b2ea78-a13c-42da-bd86-0c8d7ad77103 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:24.740925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:24.741581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:24.742041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:24.742326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:24.754635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:24.756569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:24.769430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1099/2220] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:25.410317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:25.412366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:25.432830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af47244d-61bb-4d82-bbd8-f7cc4d8a18a1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:25.444260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:25.444921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:25.445246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:25.445525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] PATH_INFO: `/v3/projects/e9c0f6f48bb747fcadc322e4121f5da3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:25.449845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9c0f6f48bb747fcadc322e4121f5da3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:25.452342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:25.556424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9c0f6f48bb747fcadc322e4121f5da3', 'request_id': 'req-dc26b8b2-123a-45f4-aa8a-8942ed562824'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.571650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9c0f6f48bb747fcadc322e4121f5da3', 'request_id': 'req-dc26b8b2-123a-45f4-aa8a-8942ed562824'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.579296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9c0f6f48bb747fcadc322e4121f5da3', 'request_id': 'req-dc26b8b2-123a-45f4-aa8a-8942ed562824'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.593743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] The token cache is being invalidate because project e9c0f6f48bb747fcadc322e4121f5da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:25.594291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.596026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dc26b8b2-123a-45f4-aa8a-8942ed562824 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.601579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1122/2221] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:25 2022] DELETE /identity/v3/projects/e9c0f6f48bb747fcadc322e4121f5da3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:25.602914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:25.617152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac471146-c086-4eae-908c-4cdb5746f6fd service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:25.697778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:25.698766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:25.700278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:25.700278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] PATH_INFO: `/v3/users/9526a1aae4004f309ca94ff9f50690c3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:25.701354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] RBAC: Authorizing `identity:delete_user(user_id=9526a1aae4004f309ca94ff9f50690c3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:25.702874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:25.801816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9526a1aae4004f309ca94ff9f50690c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.816457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9526a1aae4004f309ca94ff9f50690c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.832770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9526a1aae4004f309ca94ff9f50690c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.833821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9526a1aae4004f309ca94ff9f50690c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.844165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9526a1aae4004f309ca94ff9f50690c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:25.882212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1100/2222] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:25 2022] DELETE /identity/v3/users/9526a1aae4004f309ca94ff9f50690c3 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:26.089164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c656-429c-4570-8af8-92ed4440c12e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:26.089455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c656-429c-4570-8af8-92ed4440c12e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:26.089737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca91c656-429c-4570-8af8-92ed4440c12e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:26.124192 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ca91c656-429c-4570-8af8-92ed4440c12e None None] MFA Rules not processed for user `323b47371833408db370c4736f4725cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:26.125577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ca91c656-429c-4570-8af8-92ed4440c12e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:26.159565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:26.229951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1123/2223] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:26 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:26.431642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:26.433482 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:26.559950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:26.583236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1463426-c94a-47f6-827e-8cfab802fe9d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:26.594587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:26.595641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:26.595925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:26.596203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] PATH_INFO: `/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:26.597558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=22bb9cf2b51b4f1d94ea451ca0ecd1a0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:26.599510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:26.725681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '22bb9cf2b51b4f1d94ea451ca0ecd1a0', 'request_id': 'req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:26.736162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '22bb9cf2b51b4f1d94ea451ca0ecd1a0', 'request_id': 'req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:26.758198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '22bb9cf2b51b4f1d94ea451ca0ecd1a0', 'request_id': 'req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:26.783619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] The token cache is being invalidate because project 22bb9cf2b51b4f1d94ea451ca0ecd1a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:26.783920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:26.784956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:26.793436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1101/2224] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:26 2022] DELETE /identity/v3/projects/22bb9cf2b51b4f1d94ea451ca0ecd1a0 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:26.796255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74b24-c6ea-4f61-a525-94ab2244aa7c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:26.796710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74b24-c6ea-4f61-a525-94ab2244aa7c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:26.796787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa74b24-c6ea-4f61-a525-94ab2244aa7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:26.842785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ffa74b24-c6ea-4f61-a525-94ab2244aa7c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:26.844055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ffa74b24-c6ea-4f61-a525-94ab2244aa7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:26.926907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:26.930575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:27.006680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1124/2225] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:27.014539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.014841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.015094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.048187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe848e8-0e2f-41fe-bef2-b6bc2b872d3d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.052493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.053117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.053425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.053703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.054081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:27.055282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:27.055679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:27.079826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1125/2226] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:11:27.084137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.095817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c459d-1b4b-4619-93b6-cf60754c0442 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.102848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.103466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.103741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.104008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.104658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:27.104957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.106580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.120691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1126/2227] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:27.125128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.137262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c417971c-c4b3-4d92-8e7b-d0be305c5829 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.148334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.149085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.149772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.149772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.150548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.154391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.180047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.182922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.205062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1127/2228] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/projects => generated 389 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:27.206292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1102/2229] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:27.208750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.350850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0713dc74-00fe-4ecc-b7fa-8d96a876a4c2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.357021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.358020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.358371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.358577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.360422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.362263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.410966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1128/2230] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/users => generated 295 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:27.415025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.430286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d8fcfa-68f9-4839-9625-f02f183cb3c2 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.444345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.446049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.449653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.450093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.451804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.455646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.480518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1103/2231] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:27.482199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.499944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e520e5ef-bae2-4e4a-8627-b6b4065ffafc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.541681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.542314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.542595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.542881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.543537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.546893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76bc05c-2d2b-4939-9951-5586ec467b05 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.578794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1129/2232] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:27.580003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:27.621602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b880531-9a85-40cb-b8fc-6bc028d1f74e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:27.633395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:27.634730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.637325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.639914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] PATH_INFO: `/v3/projects/9bc804cb22d944e2af39cfddb5be6904/users/ec1762bb38e146e181164027b36eaabd/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.674224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9bc804cb22d944e2af39cfddb5be6904, user_id=ec1762bb38e146e181164027b36eaabd, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:27.677967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:27.682167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:27.707726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1104/2233] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:27 2022] PUT /identity/v3/projects/9bc804cb22d944e2af39cfddb5be6904/users/ec1762bb38e146e181164027b36eaabd/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:27.721767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:27.722121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:27.722335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:27.735961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:27.806358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] MFA Rules not processed for user `ec1762bb38e146e181164027b36eaabd`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:27.813120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:27.977704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1130/2234] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:27.979131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.195252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817408-35c6-4591-8e68-808e053902c9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.213272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.214906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.215196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.215478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.217266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.225251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.309593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1105/2235] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:27 2022] POST /identity/v3/projects => generated 385 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:28.314607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.341029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386ef0cc-1a0d-403a-827f-9e3f7d6f22cb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.519122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.519934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.520217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.520494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.521138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.523182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.569701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1131/2236] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:28 2022] POST /identity/v3/users => generated 299 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:28.572231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.595703 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc773e40-b39f-4ce9-9e4d-4286820b98c2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.602143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.603413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.603700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.603981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.604637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.606399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.621909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1106/2237] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:28.628254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.643731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d1dded-807a-4ec8-9f74-01450690842c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.656904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.657635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.657917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.658395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] PATH_INFO: `/v3/projects/225bb126cb904e8eb26fb1dec7d32eda/users/c514bdad18d64cc0be6c51b5295e151f/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.704500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225bb126cb904e8eb26fb1dec7d32eda, user_id=c514bdad18d64cc0be6c51b5295e151f, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.708283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.778697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1132/2238] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:28 2022] PUT /identity/v3/projects/225bb126cb904e8eb26fb1dec7d32eda/users/c514bdad18d64cc0be6c51b5295e151f/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:28.780261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.802989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5eacb0-d773-462b-b710-27ddda74429c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:28.948937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:28.949665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:28.950406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:28.951337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:28.952067 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:28.954785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9ae2c5-af6b-47c6-8bf0-dec5adec5082 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:28.973344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1107/2239] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:28.982428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:28.998821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea476d37-4fff-472e-88f9-56e76bf9f2a5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.006150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.006840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.007123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.007398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] PATH_INFO: `/v3/projects/225bb126cb904e8eb26fb1dec7d32eda/users/c514bdad18d64cc0be6c51b5295e151f/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.010180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=225bb126cb904e8eb26fb1dec7d32eda, user_id=c514bdad18d64cc0be6c51b5295e151f, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.012976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.024196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1133/2240] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:28 2022] PUT /identity/v3/projects/225bb126cb904e8eb26fb1dec7d32eda/users/c514bdad18d64cc0be6c51b5295e151f/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:29.034946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.035487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.035586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.068470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] MFA Rules not processed for user `c514bdad18d64cc0be6c51b5295e151f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:29.069906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:29.151642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:29.181641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1108/2241] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:29.197155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.199825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:29.270532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:29.281073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63709bd7-a5a9-4945-8438-b3b9356292f1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.285050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.285700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.285982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.286258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.301471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.302918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa9a081-cc22-40d1-b1f1-3618c0abaae8 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.316750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1134/2242] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:29 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:29.525369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.633874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace168c-8a65-433f-8049-1f24adacec9a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.647677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.648474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.648763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.649041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] PATH_INFO: `/v3/users/ec1762bb38e146e181164027b36eaabd` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.650271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec1762bb38e146e181164027b36eaabd)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.652188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.709094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec1762bb38e146e181164027b36eaabd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:29.717108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec1762bb38e146e181164027b36eaabd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:29.731182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec1762bb38e146e181164027b36eaabd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:29.732848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec1762bb38e146e181164027b36eaabd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:29.741855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec1762bb38e146e181164027b36eaabd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:29.751007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1109/2243] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:29 2022] DELETE /identity/v3/users/ec1762bb38e146e181164027b36eaabd => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:29.755186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.755670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.756015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.778379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:29.779774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:29.864659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1135/2244] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:29.877090 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:29.878765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:29.955055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb197409-3878-41a9-8913-5cbb2cd55b5f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:29.957454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:29.958079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:29.958352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:29.958627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:29.972042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:29.972042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:29.987104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1110/2245] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:30.715233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:30.717987 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:30.743848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d23e25-0aaf-4bc6-911c-7e97292c719d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:30.750254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:30.752301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:30.752823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:30.753516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] PATH_INFO: `/v3/projects/9bc804cb22d944e2af39cfddb5be6904` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:30.754995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9bc804cb22d944e2af39cfddb5be6904)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:30.757307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:30.842243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9bc804cb22d944e2af39cfddb5be6904', 'request_id': 'req-77ff58c6-017e-44ba-9ad1-b536191ade3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:30.861337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9bc804cb22d944e2af39cfddb5be6904', 'request_id': 'req-77ff58c6-017e-44ba-9ad1-b536191ade3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:30.878249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9bc804cb22d944e2af39cfddb5be6904', 'request_id': 'req-77ff58c6-017e-44ba-9ad1-b536191ade3f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:30.892648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] The token cache is being invalidate because project 9bc804cb22d944e2af39cfddb5be6904 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:30.893955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:30.894787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:30.900416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1136/2246] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:30 2022] DELETE /identity/v3/projects/9bc804cb22d944e2af39cfddb5be6904 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:30.901760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:30.915559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8767ba23-91d3-4af1-b92d-8f7aaaeb12a8 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:30.952878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:31.059976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:31.061401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:31.061401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:31.061401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] PATH_INFO: `/v3/users/c514bdad18d64cc0be6c51b5295e151f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:31.064330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c514bdad18d64cc0be6c51b5295e151f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:31.066528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:31.197116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c514bdad18d64cc0be6c51b5295e151f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.217865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c514bdad18d64cc0be6c51b5295e151f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.250878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c514bdad18d64cc0be6c51b5295e151f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.251935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c514bdad18d64cc0be6c51b5295e151f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.278390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-01defe63-e5ab-47ab-8fe2-369476f7a1b3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c514bdad18d64cc0be6c51b5295e151f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.286159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1111/2247] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:30 2022] DELETE /identity/v3/users/c514bdad18d64cc0be6c51b5295e151f => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:31.699242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:31.700633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:31.735570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff58c6-017e-44ba-9ad1-b536191ade3f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:31.816713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:31.817577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:31.817880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:31.818157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] PATH_INFO: `/v3/projects/225bb126cb904e8eb26fb1dec7d32eda` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:31.819313 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] RBAC: Authorizing `identity:delete_project(project_id=225bb126cb904e8eb26fb1dec7d32eda)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:31.822601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:31.846466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:31.910522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '225bb126cb904e8eb26fb1dec7d32eda', 'request_id': 'req-e33b4690-3c5a-4e85-9722-9f69ea159f4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.924754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '225bb126cb904e8eb26fb1dec7d32eda', 'request_id': 'req-e33b4690-3c5a-4e85-9722-9f69ea159f4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.954847 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '225bb126cb904e8eb26fb1dec7d32eda', 'request_id': 'req-e33b4690-3c5a-4e85-9722-9f69ea159f4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.980326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] The token cache is being invalidate because project 225bb126cb904e8eb26fb1dec7d32eda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:31.980678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.981547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e33b4690-3c5a-4e85-9722-9f69ea159f4f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:31.984524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1137/2248] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:31 2022] DELETE /identity/v3/projects/225bb126cb904e8eb26fb1dec7d32eda => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:31.989111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:31.989596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:31.989708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.032692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:32.034200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:32.145742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1112/2249] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:32.155408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.155408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.155408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.185537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:32.186832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:32.197220 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1138/2250] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:32.201390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.219224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea680052-a81a-4946-9cce-0480e2703086 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.228547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.229177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.230157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.230157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.230389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:32.230698 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.232673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.261017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1113/2251] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:32.265338 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.285385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c185873e-5180-445a-98b7-914a80d1ef13 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.289580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.290294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.290644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.290983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.291702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.293804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.334732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1139/2252] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:32 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:32.339270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.359358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde0f28f-22fb-4041-80f8-daa087da1644 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.390643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:32.494452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.495917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.496679 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.497456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.499109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.501463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.550801 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1114/2253] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:32 2022] POST /identity/v3/users => generated 293 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:11:32.554536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.573166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55b15c6-0200-47b2-b47c-f433b4d84d25 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.591885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.592679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.593051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.593444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.594227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.596784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.614139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1140/2254] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:32.619706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.635247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03c2560-e442-4646-92c1-592ad2acede4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.640340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.641115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.641473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.641812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.642546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.644134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b51755cf-3b77-41bf-858e-2f1baa63ff25 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.660566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1115/2255] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:32 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:32.661668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.672919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc635b4e-071f-45df-b87c-1617040dc156 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:32.680623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:32.681650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.682182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.682715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] PATH_INFO: `/v3/projects/5c1e7357805e446d9d3423d2c2896934/users/422f8730eaf146b4ae00b0cd319a25b5/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.702071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c1e7357805e446d9d3423d2c2896934, user_id=422f8730eaf146b4ae00b0cd319a25b5, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:32.705397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:32.724631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1141/2256] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:32 2022] PUT /identity/v3/projects/5c1e7357805e446d9d3423d2c2896934/users/422f8730eaf146b4ae00b0cd319a25b5/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:32.737468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:32.737785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:32.738092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:32.773781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] MFA Rules not processed for user `422f8730eaf146b4ae00b0cd319a25b5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:32.775030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:32.858212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1116/2257] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:32.875025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:32.879850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:33.006451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f454b7-cd54-4688-ab90-70d09a7020aa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:33.019518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:33.020517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.021110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.025409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.052051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:33.053831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc16a1-01ce-4826-9d09-f4ebbf3d44e0 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:33.065357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1142/2258] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:32 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:33.094094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:33.214945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647af84-3456-4613-9bcd-472c5717c1d8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:33.222899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:33.224079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.224460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.225014 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] PATH_INFO: `/v3/users/422f8730eaf146b4ae00b0cd319a25b5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.226310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] RBAC: Authorizing `identity:delete_user(user_id=422f8730eaf146b4ae00b0cd319a25b5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:33.228503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:33.314962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:33.341427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '422f8730eaf146b4ae00b0cd319a25b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:33.352274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '422f8730eaf146b4ae00b0cd319a25b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:33.387024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '422f8730eaf146b4ae00b0cd319a25b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:33.387806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '422f8730eaf146b4ae00b0cd319a25b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:33.402600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '422f8730eaf146b4ae00b0cd319a25b5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:33.410155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1117/2259] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:33 2022] DELETE /identity/v3/users/422f8730eaf146b4ae00b0cd319a25b5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:33.415040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4a72-2850-4f18-b9d6-3c7e353f1f0e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.415408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4a72-2850-4f18-b9d6-3c7e353f1f0e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.415763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d4a72-2850-4f18-b9d6-3c7e353f1f0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.456151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-167d4a72-2850-4f18-b9d6-3c7e353f1f0e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:33.457992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-167d4a72-2850-4f18-b9d6-3c7e353f1f0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:33.514050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:33.600557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1143/2260] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:33.606330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:33.615441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:33.749948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18493709-d118-43dc-a327-bbe3e14e0977 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:33.759954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:33.761255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:33.761772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:33.762838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:33.777294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:33.779983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:33.791954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1118/2261] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:11:34.364029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3108b-3581-4230-bf9f-4239634a15e5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.364692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3108b-3581-4230-bf9f-4239634a15e5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.364692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d3108b-3581-4230-bf9f-4239634a15e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.386431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-69d3108b-3581-4230-bf9f-4239634a15e5 None None] MFA Rules not processed for user `62d11a74dcb3419eb119f8771bfc9cf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:34.387823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-69d3108b-3581-4230-bf9f-4239634a15e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:34.453520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1144/2262] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:34.701439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:34.703434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:34.726093 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d61f476-c6f1-4a2d-8f1e-33e841241044 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:34.737635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:34.738958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.740941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.741445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] PATH_INFO: `/v3/projects/5c1e7357805e446d9d3423d2c2896934` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.744210 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c1e7357805e446d9d3423d2c2896934)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:34.750219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:34.849147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c1e7357805e446d9d3423d2c2896934', 'request_id': 'req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:34.867088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c1e7357805e446d9d3423d2c2896934', 'request_id': 'req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:34.874615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c1e7357805e446d9d3423d2c2896934', 'request_id': 'req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:34.896170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] The token cache is being invalidate because project 5c1e7357805e446d9d3423d2c2896934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:34.896825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:34.898327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dc504fd1-0da1-45ea-abfd-0fe9f515cbd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:34.901211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1119/2263] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:34 2022] DELETE /identity/v3/projects/5c1e7357805e446d9d3423d2c2896934 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:34.907153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:34.907675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:34.908101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:34.932731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:34.941223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:35.027101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1145/2264] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:35.035631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.035925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.036204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.070904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:35.072142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:35.081741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1120/2265] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:35.086039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.097395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ffd42b-7817-4178-a3b0-9d77dd9fdef3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.106175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.106175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.106175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.106175 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.107813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:35.108217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.110089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.125218 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1146/2266] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:35.130867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.145258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a38707-7e52-4fbd-b2ee-bcca610c7b34 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.150621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.151357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.151644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.151917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.152553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.154687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.206331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1121/2267] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:35 2022] POST /identity/v3/projects => generated 371 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:35.210200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.237088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834d6208-3318-46f7-8413-e42ffaa3cb52 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.363507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.364136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.364727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.364727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.365322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.367396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.416435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1147/2268] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:35 2022] POST /identity/v3/users => generated 286 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:35.420717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.429442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:35.434520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ebc174-2e9f-4c8f-a766-0c194bc56c7e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.452358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.453327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.453600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.453904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.454593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.456245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.470299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1122/2269] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:35.474106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.480853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:35.486288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c45c91-fbaf-433b-b1a9-274424b388b9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.492554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.493164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.493497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.493889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.494573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.496209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fc3344-e374-4da2-9991-571b53d0e7d8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.507700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1148/2270] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:35.512042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.522313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d76585e8-6f4b-4a12-b70b-dfb1b0d53a0f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.527348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.528040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.528322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.529640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] PATH_INFO: `/v3/projects/98929ad9887a49b2b36f91b43f78b7b1/users/367245cea8f24a1eb51c5c37cf24d322/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.545781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98929ad9887a49b2b36f91b43f78b7b1, user_id=367245cea8f24a1eb51c5c37cf24d322, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.548532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.562914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1123/2271] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:35 2022] PUT /identity/v3/projects/98929ad9887a49b2b36f91b43f78b7b1/users/367245cea8f24a1eb51c5c37cf24d322/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:11:35.573526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9e7d-0270-4b6d-914c-8c9cd63583ed None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.573819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9e7d-0270-4b6d-914c-8c9cd63583ed None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.574095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b9e7d-0270-4b6d-914c-8c9cd63583ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.610850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-835b9e7d-0270-4b6d-914c-8c9cd63583ed None None] MFA Rules not processed for user `367245cea8f24a1eb51c5c37cf24d322`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:35.612241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-835b9e7d-0270-4b6d-914c-8c9cd63583ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:35.691021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1149/2272] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:35 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:35.704582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:35.706813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:35.773459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5a89f4-12e3-48c9-a019-143ba7f43fa4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:35.777081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:35.777725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:35.778007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:35.778280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:35.787415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:35.788832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:35.797906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1124/2273] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:35 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:40.496374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:40.496905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:40.496905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:40.518574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:40.519865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:40.611203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1150/2274] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:11:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:40.626975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:40.628663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:40.751852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88242a9-9a87-4a79-b057-b980fe8d92b3 service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:40.759611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:40.760060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:40.760538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:40.761114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:40.784834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:40.786592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:40.811277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1125/2275] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:11:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:50.602411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=60 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:50.793030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=71,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:51.935540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:51.937749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:52.016093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec13103-2e02-4d9d-9a64-145dfbcaa8cb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:52.020593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:52.021277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:52.021556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:52.021828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] PATH_INFO: `/v3/users/17a540de2ab94652922926c059f9ca8a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:52.023001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=17a540de2ab94652922926c059f9ca8a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:52.024873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:52.072231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17a540de2ab94652922926c059f9ca8a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.079760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17a540de2ab94652922926c059f9ca8a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.088813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17a540de2ab94652922926c059f9ca8a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.089476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17a540de2ab94652922926c059f9ca8a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.115151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17a540de2ab94652922926c059f9ca8a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.121467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1151/2276] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:51 2022] DELETE /identity/v3/users/17a540de2ab94652922926c059f9ca8a => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:52.491054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:52.505580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904627e1-8c67-4d2c-adce-2eceb3851212 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:52.572740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:52.573585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:52.573870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:52.574147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] PATH_INFO: `/v3/projects/18186fc8d5ab4af8a6738ed55472a3ea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:52.576356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18186fc8d5ab4af8a6738ed55472a3ea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:52.579377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:52.637456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18186fc8d5ab4af8a6738ed55472a3ea', 'request_id': 'req-7416e0f2-9065-4b2a-89ec-f3942a113635'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.648179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18186fc8d5ab4af8a6738ed55472a3ea', 'request_id': 'req-7416e0f2-9065-4b2a-89ec-f3942a113635'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.656277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18186fc8d5ab4af8a6738ed55472a3ea', 'request_id': 'req-7416e0f2-9065-4b2a-89ec-f3942a113635'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.670355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] The token cache is being invalidate because project 18186fc8d5ab4af8a6738ed55472a3ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:52.670717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.672379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.676890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1126/2277] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:52 2022] DELETE /identity/v3/projects/18186fc8d5ab4af8a6738ed55472a3ea => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:52.678520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:52.680260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:52.698636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd0f41b-b788-44f5-baea-4b34951e9c5a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:52.768284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:52.769040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:52.769403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:52.769895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] PATH_INFO: `/v3/users/a062a821fc444edbb51eae0986304034` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:52.771255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a062a821fc444edbb51eae0986304034)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:52.773761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:52.810480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:52.863788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a062a821fc444edbb51eae0986304034'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.876343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a062a821fc444edbb51eae0986304034'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.888880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a062a821fc444edbb51eae0986304034'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.889593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a062a821fc444edbb51eae0986304034'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.916000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5f231b66-9a20-4d42-b60b-ddfd84dc1947 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a062a821fc444edbb51eae0986304034'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:52.925239 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1152/2278] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:52 2022] DELETE /identity/v3/users/a062a821fc444edbb51eae0986304034 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:53.471755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.473532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:53.487835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7416e0f2-9065-4b2a-89ec-f3942a113635 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:53.560609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:53.561487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.561834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.562098 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] PATH_INFO: `/v3/projects/04dfb52259b04aecb283dda7a779c44f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.563458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] RBAC: Authorizing `identity:delete_project(project_id=04dfb52259b04aecb283dda7a779c44f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:53.565500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:53.632513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:53.654040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04dfb52259b04aecb283dda7a779c44f', 'request_id': 'req-bdc20c92-cbff-4f00-82da-4c54db313e5a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:53.663451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04dfb52259b04aecb283dda7a779c44f', 'request_id': 'req-bdc20c92-cbff-4f00-82da-4c54db313e5a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:53.674871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04dfb52259b04aecb283dda7a779c44f', 'request_id': 'req-bdc20c92-cbff-4f00-82da-4c54db313e5a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:53.697091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] The token cache is being invalidate because project 04dfb52259b04aecb283dda7a779c44f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:53.697923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:53.698789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bdc20c92-cbff-4f00-82da-4c54db313e5a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:53.710171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1127/2279] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:53 2022] DELETE /identity/v3/projects/04dfb52259b04aecb283dda7a779c44f => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:53.715253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.716103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.716653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.742330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:53.744651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:53.833000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1153/2280] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:11:53.841346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.841774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.842154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.884690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:53.884690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:53.894796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1128/2281] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:53.898783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.913427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a750ef53-21de-4359-b3cb-757aaeeac28a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:53.942701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:53.943347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.943698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.943905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.944639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:53.944939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:53.946886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:53.961298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1154/2282] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 01 05:11:53.970307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:53.979833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b5e329-cc3b-4dcf-8ce5-929b03d9ff62 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:53.985629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:53.986239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:53.986518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:53.986788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:53.987415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:53.989379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.019609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1129/2283] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:53 2022] POST /identity/v3/projects => generated 361 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:54.023554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.033834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da35d998-2baf-4d77-8b2f-fe5c52fe0d83 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.100481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.101113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.101454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.101703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.102337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.104319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.129233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1155/2284] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:54 2022] POST /identity/v3/users => generated 281 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:54.133526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.149381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e864687-c28b-47ad-a54f-349d4d28e386 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.150137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.150746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.151020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.151288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.151922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.153646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.168557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1130/2285] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:54.173217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.185661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03833986-c224-43ce-9aca-ce690c5093d9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.191821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.192581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.192951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.193352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.194115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.195918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d41fd7-862a-457f-a933-c0f343d9b2b9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.210256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1156/2286] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:54 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:54.214929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.228248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23ea89a-a7b5-498f-a2c4-e9a08e3020b6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.235507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.236410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.236827 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.237226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] PATH_INFO: `/v3/projects/41c1aab2fdf54d858bb77c0c2c4ad4f2/users/d06a59be1a7f45daa0086a76ef4f5fd2/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.256782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] RBAC: Authorizing `identity:create_grant(project_id=41c1aab2fdf54d858bb77c0c2c4ad4f2, user_id=d06a59be1a7f45daa0086a76ef4f5fd2, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.259843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.276164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1131/2287] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:54 2022] PUT /identity/v3/projects/41c1aab2fdf54d858bb77c0c2c4ad4f2/users/d06a59be1a7f45daa0086a76ef4f5fd2/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:11:54.289237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.289237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.289937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.301570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:54.334777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] MFA Rules not processed for user `d06a59be1a7f45daa0086a76ef4f5fd2`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:54.336088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:54.414189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1157/2288] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:54.452099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.454378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:54.518625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e280aec1-ed8c-491f-b37a-a171b01c542a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.523341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.523951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.524309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.524547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.534993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.536425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22a4050-98ce-4c6f-aa55-451140c80844 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.545692 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1132/2289] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:54.561136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.636852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0396cfb-6914-4286-8c3c-25d9b93701b7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.642245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.642876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.643185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.643468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] PATH_INFO: `/v3/users/d06a59be1a7f45daa0086a76ef4f5fd2` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.645001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d06a59be1a7f45daa0086a76ef4f5fd2)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.646994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.698283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd06a59be1a7f45daa0086a76ef4f5fd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:54.706589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd06a59be1a7f45daa0086a76ef4f5fd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:54.713492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd06a59be1a7f45daa0086a76ef4f5fd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:54.714139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd06a59be1a7f45daa0086a76ef4f5fd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:54.727461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd06a59be1a7f45daa0086a76ef4f5fd2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:54.733540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1158/2290] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:54 2022] DELETE /identity/v3/users/d06a59be1a7f45daa0086a76ef4f5fd2 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:54.738356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.738833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.738935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.758406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:54.759620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:54.812042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:54.821822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1133/2291] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:54.832032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:54.833482 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:54.848582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:54.902227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b15413-c97e-46eb-8ffe-53746643b05d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:54.906532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:54.907147 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:54.907431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:54.907718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:54.917445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:54.918899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcf46cc-ca39-441a-89f9-4f0ba809785b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:54.929446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1159/2292] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:55.367245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.369069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:55.385575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2ae3ef-56dc-493b-a9e9-17e246f62a39 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:55.392239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:55.402624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.402624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.402624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] PATH_INFO: `/v3/projects/41c1aab2fdf54d858bb77c0c2c4ad4f2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.408847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] RBAC: Authorizing `identity:delete_project(project_id=41c1aab2fdf54d858bb77c0c2c4ad4f2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:55.412446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:55.510313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '41c1aab2fdf54d858bb77c0c2c4ad4f2', 'request_id': 'req-8ed422f9-60af-4a82-9db7-b0c1fa054aef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:55.526498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '41c1aab2fdf54d858bb77c0c2c4ad4f2', 'request_id': 'req-8ed422f9-60af-4a82-9db7-b0c1fa054aef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:55.532926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '41c1aab2fdf54d858bb77c0c2c4ad4f2', 'request_id': 'req-8ed422f9-60af-4a82-9db7-b0c1fa054aef'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:55.549088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] The token cache is being invalidate because project 41c1aab2fdf54d858bb77c0c2c4ad4f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:11:55.549401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:55.550048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8ed422f9-60af-4a82-9db7-b0c1fa054aef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:55.551983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1134/2293] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:11:55 2022] DELETE /identity/v3/projects/41c1aab2fdf54d858bb77c0c2c4ad4f2 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:55.556828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.557117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.557448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.581893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:55.583737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:55.669757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1160/2294] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:55.678240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.678766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.679216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.708591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:55.710265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:55.727416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1135/2295] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:55.728635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.743343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e423d-d7b5-4c43-b017-8bbbe15296ca None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:55.761132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:55.761804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.762087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.762360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.763103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:11:55.763412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:55.765775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:55.781296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1161/2296] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:11:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:11:55.783688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.794662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3846ef45-51cc-4074-852c-a7b3d7d8edc8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:55.800749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:55.802377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.802611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.802845 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.803638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:55.806337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:55.840114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1136/2297] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:11:55 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:55.844883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.860403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f82733-3dbd-42ef-bda3-4065a8efe0d8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:55.921865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:55.922612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.922893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.923165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.923828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:55.925779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:55.948385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1162/2298] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:11:55 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:11:55.952577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.962755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263ed903-b24b-4142-81cf-85aa9cc583d4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:55.967343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:55.967981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:55.968257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:55.968532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:55.969455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:55.971037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:55.980739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1137/2299] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:55.985348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:55.995528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e46d416-43dc-405f-939f-75048f0a491f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:56.000764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:56.001376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:56.001658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:56.001957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:56.002597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:56.004203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f345567-69c2-46b9-8eec-2406d70f24b5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:56.014949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1163/2300] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:11:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:11:56.019120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:56.028981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41347f51-970a-4a7e-9a20-73c5c491c4ec admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:56.033894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:56.034547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:56.034826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:56.035099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] PATH_INFO: `/v3/projects/92658e11d56e400ea39031b3f55a59cb/users/dde4e37cd6254168a255079ce1c01194/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:56.050257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92658e11d56e400ea39031b3f55a59cb, user_id=dde4e37cd6254168a255079ce1c01194, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:56.052959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:56.066391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1138/2301] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:11:56 2022] PUT /identity/v3/projects/92658e11d56e400ea39031b3f55a59cb/users/dde4e37cd6254168a255079ce1c01194/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:11:56.077405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410f8d7-ca2c-4f44-a9dc-27bdbfc1ce9a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:56.077705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410f8d7-ca2c-4f44-a9dc-27bdbfc1ce9a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:56.077981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2410f8d7-ca2c-4f44-a9dc-27bdbfc1ce9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:56.105505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2410f8d7-ca2c-4f44-a9dc-27bdbfc1ce9a None None] MFA Rules not processed for user `dde4e37cd6254168a255079ce1c01194`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:56.106737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2410f8d7-ca2c-4f44-a9dc-27bdbfc1ce9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:56.116984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:56.172628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1164/2302] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:56.183776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:56.185552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:56.244236 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5051d0e-f892-4615-bac4-96afab6c7255 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:56.247876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:56.248728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:56.248862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:56.249564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:56.258668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:56.260576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:56.271644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1139/2303] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:11:56 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:11:58.142093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6406-4668-44f8-8418-590ab6e35cd2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:58.142588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6406-4668-44f8-8418-590ab6e35cd2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:58.142863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6e6406-4668-44f8-8418-590ab6e35cd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:58.168818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5a6e6406-4668-44f8-8418-590ab6e35cd2 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:58.170030 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a6e6406-4668-44f8-8418-590ab6e35cd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:58.258291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1165/2304] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:58.275728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:58.278331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:58.351368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:11:58.392205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:58.392487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:58.392808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:58.418557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] MFA Rules not processed for user `5ed5cf12b4354c7d88fe6e69f15cf335`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:58.422151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:58.432984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf3031e-f296-413f-b437-718508da006d service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:58.442488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:58.443357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:58.443683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:58.443964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:58.456155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:58.457988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c15866-2f57-471b-b445-89c19b2416c7 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:58.470348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1140/2305] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:11:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:58.537756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1166/2306] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:11:58 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:59.144983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647519-9711-4acc-9f08-935119cfd45b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:59.146061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647519-9711-4acc-9f08-935119cfd45b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:59.146471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86647519-9711-4acc-9f08-935119cfd45b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:59.168650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-86647519-9711-4acc-9f08-935119cfd45b None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:59.170175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-86647519-9711-4acc-9f08-935119cfd45b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:59.187818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1141/2307] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:59.201554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:59.217907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6541cec0-53e9-4373-b971-da7eb5b70bb8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:59.224503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:59.226002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:59.226299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:59.226584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:59.239112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:59.240723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:59.254648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1167/2308] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:11:59.677129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:59.677668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:59.677781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:59.722261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:11:59.722261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:11:59.730442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1142/2309] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:11:59 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:11:59.743363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:59.754920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2caa1a1-f7d9-4a49-a758-31502724aa9a service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:59.759805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:59.760415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:59.760701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:59.761005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:59.769376 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:59.770959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e784c7d3-d493-4bb7-b6a9-1f1ecd70c6d1 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:59.782686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1168/2310] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:11:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:11:59.821553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:11:59.900318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef7094-6124-40e4-a487-34da10c77cdc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:11:59.906521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:11:59.907301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:11:59.907959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:11:59.908282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] PATH_INFO: `/v3/users/dde4e37cd6254168a255079ce1c01194` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:11:59.909747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=dde4e37cd6254168a255079ce1c01194)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:11:59.911887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:11:59.974680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dde4e37cd6254168a255079ce1c01194'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:59.981984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dde4e37cd6254168a255079ce1c01194'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:59.995375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dde4e37cd6254168a255079ce1c01194'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:11:59.996058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dde4e37cd6254168a255079ce1c01194'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:00.006977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dde4e37cd6254168a255079ce1c01194'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:00.015672 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1143/2311] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:11:59 2022] DELETE /identity/v3/users/dde4e37cd6254168a255079ce1c01194 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:00.020467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade232-d923-4358-99eb-26bfdba752b9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:00.020950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade232-d923-4358-99eb-26bfdba752b9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:00.021423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ade232-d923-4358-99eb-26bfdba752b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:00.043875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-31ade232-d923-4358-99eb-26bfdba752b9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:00.045455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-31ade232-d923-4358-99eb-26bfdba752b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:00.088590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:00.162992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1169/2312] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:00.174866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:00.176594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:00.206273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:00.221240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:00.222088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:00.222520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:00.247595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:00.249649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:00.302739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbb5788-e20a-4a2c-8d0c-89d9aa8590ad admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:00.308118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:00.308907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:00.309381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:00.309780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:00.320940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1170/2313] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:12:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:00.330111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:00.331301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:00.331666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:00.332747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:00.347380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1144/2314] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:00.449437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44a5993-e929-4caf-8c06-d84e9d937d11 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:00.459556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:00.460257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:00.460547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:00.461394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:00.482955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:00.485705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8454cf0b-c264-4910-8250-28f7b8cf481b service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:00.519411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1171/2315] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:12:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 01 05:12:01.135600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:01.138323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:01.191352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c89d2-a9a2-4b2c-a97e-070479294f03 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:01.220203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:01.220203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.220203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.220203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] PATH_INFO: `/v3/projects/92658e11d56e400ea39031b3f55a59cb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.220543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92658e11d56e400ea39031b3f55a59cb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:01.220543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:01.354564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92658e11d56e400ea39031b3f55a59cb', 'request_id': 'req-c90dcccd-594a-410d-a4bf-9636e2453323'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:01.363870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92658e11d56e400ea39031b3f55a59cb', 'request_id': 'req-c90dcccd-594a-410d-a4bf-9636e2453323'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:01.376668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92658e11d56e400ea39031b3f55a59cb', 'request_id': 'req-c90dcccd-594a-410d-a4bf-9636e2453323'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:01.409498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] The token cache is being invalidate because project 92658e11d56e400ea39031b3f55a59cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:01.409907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:01.412720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c90dcccd-594a-410d-a4bf-9636e2453323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:01.415516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1145/2316] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:01 2022] DELETE /identity/v3/projects/92658e11d56e400ea39031b3f55a59cb => generated 0 bytes in 281 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:01.421000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.421553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.421936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.445375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:01.446595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:01.509046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1172/2317] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:01.517535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.517824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.518132 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.539206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:01.540451 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:01.562914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1146/2318] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:01.567584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:01.586284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d73c0b9-dc8e-44cb-945c-f125753627a6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:01.593666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:01.594758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.608035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.608798 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.618202 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:12:01.618606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:01.620576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:01.634722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:01.659092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1173/2319] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:12:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:12:01.663947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:01.675591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deed4a3-eafd-4cff-ba6a-ebfb7eeef192 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:01.688893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:01.691340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.692503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.693298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.694589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:01.696737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:01.771154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1147/2320] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:01 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:01.778638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:01.778786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:01.781636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:01.820491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004e2d9-0e11-4957-b005-bc89643c3f5b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:01.900541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:01.901754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.902217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.902671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] PATH_INFO: `/v3/users/367245cea8f24a1eb51c5c37cf24d322` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.904298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] RBAC: Authorizing `identity:delete_user(user_id=367245cea8f24a1eb51c5c37cf24d322)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:01.906889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:01.959997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dae1b7-6266-48bd-8d8c-f50802bcf26a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:01.984816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:01.986274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:01.986748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:01.987173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:01.988001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:01.990165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.018546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '367245cea8f24a1eb51c5c37cf24d322'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:02.029071 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '367245cea8f24a1eb51c5c37cf24d322'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:02.050362 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '367245cea8f24a1eb51c5c37cf24d322'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:02.051194 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '367245cea8f24a1eb51c5c37cf24d322'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:02.066234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f348bae3-f6f9-4bb5-b8c0-998b689c666d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '367245cea8f24a1eb51c5c37cf24d322'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:02.066835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1148/2321] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:01 2022] POST /identity/v3/users => generated 293 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:02.074289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.082658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:02.083183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1174/2322] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:01 2022] DELETE /identity/v3/users/367245cea8f24a1eb51c5c37cf24d322 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:02.087576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.088383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.088971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.100186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:02.107506 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2508a212-bdba-4360-add1-dddf0928e9d2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.143163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:02.144628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:02.198038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.199225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.199575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.199915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.200756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.203009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.217270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1149/2323] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:02.223619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.232208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4eb4d9-a515-4dd0-b610-d795e479ab6c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.239202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.240203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.240493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.240769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.241583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.243181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.253836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1175/2324] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:02.256800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1150/2325] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:12:02.261272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.262209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.262748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:02.279121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d383c79e-4b12-459c-a5b3-f417e547bee6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.286566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.287504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.287936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.289788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] PATH_INFO: `/v3/projects/34de750642154b7aa42e09807e421622/users/6ed9b28855454791a520b9b280764c1d/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.309228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:02.317036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34de750642154b7aa42e09807e421622, user_id=6ed9b28855454791a520b9b280764c1d, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.321806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a6501c-d9ae-46ae-85cd-422a9483b587 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.366099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1151/2326] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:02 2022] PUT /identity/v3/projects/34de750642154b7aa42e09807e421622/users/6ed9b28855454791a520b9b280764c1d/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:02.381201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.382277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.382729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.403982 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64ffc50-4b78-4eeb-b76a-0aec90c649e7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.465228 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] MFA Rules not processed for user `6ed9b28855454791a520b9b280764c1d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:02.466538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:02.562057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.563370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.563722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.564134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.597073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1152/2327] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:02 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:02.602456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.677725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.680388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.693843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1176/2328] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:02.695113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:02.706943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbd9202-07e9-4d69-8f99-a0825b353f06 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.713426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.714243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.714748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.715817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.716622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.720415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.767887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1153/2329] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:02 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:12:02.772453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:02.790447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e45e839-9b29-4b30-9ab1-c0e8df8a3a10 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:02.924423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:02.925441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:02.925728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:02.926002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:02.927056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:02.930196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:02.990180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1177/2330] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:02 2022] POST /identity/v3/users => generated 291 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:02.994783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.010969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf5419f-d1f7-4db9-a242-1f171c964c55 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.031411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:03.032217 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.032606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.032986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.033803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:03.036202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:03.068262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1154/2331] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:02 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:03.069483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.087643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69f026f-37a5-48e7-a793-898242a60478 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.098620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:03.099258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.099542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.099832 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.103445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:03.105308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4783325c-8296-4d4d-9ab7-e809641a5d3f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:03.150780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1178/2332] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:03 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:03.156069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.171166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c52634-7200-45a4-8a60-a21036f9885f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.185986 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:03.187452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.187697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.188033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] PATH_INFO: `/v3/projects/7110a4600a2841b496848ad9a5253a9a/users/15d00114b3f64f9f83cdba87fa2bb855/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.221960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7110a4600a2841b496848ad9a5253a9a, user_id=15d00114b3f64f9f83cdba87fa2bb855, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:03.226270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:03.286477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1155/2333] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:03 2022] PUT /identity/v3/projects/7110a4600a2841b496848ad9a5253a9a/users/15d00114b3f64f9f83cdba87fa2bb855/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:03.299462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.299942 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.300379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.310754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:03.350047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] MFA Rules not processed for user `15d00114b3f64f9f83cdba87fa2bb855`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:03.351283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:03.501558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.503931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:03.537380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1179/2334] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:03.541858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.611496 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88935f6-4f48-4806-b509-c0a5066418c0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.618333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:03.619214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.619847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.620409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] PATH_INFO: `/v3/users/a347090d79504bd5bac18c1290d3a95a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.622464 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a347090d79504bd5bac18c1290d3a95a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:03.627704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:03.643431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8ec0db-67b3-4527-af44-7b39eee90e4e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.658620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:03.659265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.659697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.660015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.660840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:03.663412 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:03.698841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a347090d79504bd5bac18c1290d3a95a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:03.708465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a347090d79504bd5bac18c1290d3a95a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:03.714166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1180/2335] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:03 2022] POST /identity/v3/projects => generated 383 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:03.715116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:03.731660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a347090d79504bd5bac18c1290d3a95a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:03.732740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a347090d79504bd5bac18c1290d3a95a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:03.746812 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-31fc26a0-1a02-4bf4-871c-c0ffc7442101 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a347090d79504bd5bac18c1290d3a95a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:03.775948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1156/2336] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:03 2022] DELETE /identity/v3/users/a347090d79504bd5bac18c1290d3a95a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:12:03.777832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:03.778188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:03.778582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:03.835181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:03.836937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:03.887972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:03.894106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c05a73-f46d-4434-9eed-a87630abbfae admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:03.938555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:04.033121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1157/2337] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:04.040411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.040411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.042789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.043216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.044146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.047829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.053535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.055196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.076624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1181/2338] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:03 2022] POST /identity/v3/users => generated 298 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:04.082359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.093110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.130881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8cb6c9-f1da-45c3-9859-880f85f6b68d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.145040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.145705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.145988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.146261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.149415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.151197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.170817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6a7ff1-9edc-4e9b-8467-ae2ca7c31c8c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.173722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1182/2339] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:04.174518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.179329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.180511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.181474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.181954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.182511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.194561 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.196818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.198439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3736cb7-7115-453b-81b2-e5ed6b87e8dc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.210354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.211008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.211296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.211572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] PATH_INFO: `/v3/projects/98929ad9887a49b2b36f91b43f78b7b1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.212732 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] RBAC: Authorizing `identity:delete_project(project_id=98929ad9887a49b2b36f91b43f78b7b1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.214733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.229572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1158/2340] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:12:04.230665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.255001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930fcb7-e543-4f21-b113-301c132179ec service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.266479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.269487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.270015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.270304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] PATH_INFO: `/v3/projects/bcfa0b2aae65403786587d7a3a1303c8/users/d895dddd1a2b42ab9f8cc500e718ce0e/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.306455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa0b2aae65403786587d7a3a1303c8, user_id=d895dddd1a2b42ab9f8cc500e718ce0e, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.307360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98929ad9887a49b2b36f91b43f78b7b1', 'request_id': 'req-ac4f522c-bfd4-47a7-a99f-e005a571499b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.309498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.319628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98929ad9887a49b2b36f91b43f78b7b1', 'request_id': 'req-ac4f522c-bfd4-47a7-a99f-e005a571499b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.330872 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98929ad9887a49b2b36f91b43f78b7b1', 'request_id': 'req-ac4f522c-bfd4-47a7-a99f-e005a571499b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.336945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1159/2341] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:04 2022] PUT /identity/v3/projects/bcfa0b2aae65403786587d7a3a1303c8/users/d895dddd1a2b42ab9f8cc500e718ce0e/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:04.341347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.348663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] The token cache is being invalidate because project 98929ad9887a49b2b36f91b43f78b7b1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:04.348663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.350545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ac4f522c-bfd4-47a7-a99f-e005a571499b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.354018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1183/2342] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:04 2022] DELETE /identity/v3/projects/98929ad9887a49b2b36f91b43f78b7b1 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:04.361330 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9d6e-9914-4a03-a666-529839a524e8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.361667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9d6e-9914-4a03-a666-529839a524e8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.362004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f9d6e-9914-4a03-a666-529839a524e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.397500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f08f9d6e-9914-4a03-a666-529839a524e8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:04.398861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f08f9d6e-9914-4a03-a666-529839a524e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.457871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555acd63-7423-4553-b36a-ac3e0cd823ef admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.464566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.465887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.466278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.466658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.468031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.470600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.500600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1160/2343] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:04 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:12:04.501881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.503709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1184/2344] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:04.503844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.510565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.510849 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.511188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.519273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aa0051-aac4-4a53-b48f-a38619a69a4e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.524182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.524918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.525340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.525690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] PATH_INFO: `/v3/projects/bcfa0b2aae65403786587d7a3a1303c8/users/d895dddd1a2b42ab9f8cc500e718ce0e/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.527878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bcfa0b2aae65403786587d7a3a1303c8, user_id=d895dddd1a2b42ab9f8cc500e718ce0e, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.531595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf07cd0-fc39-440a-877c-0b954ad54d8e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.534768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:04.535983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.558296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1161/2345] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:04 2022] PUT /identity/v3/projects/bcfa0b2aae65403786587d7a3a1303c8/users/d895dddd1a2b42ab9f8cc500e718ce0e/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:04.561342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:04.567900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.568185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.568712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.625417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] MFA Rules not processed for user `d895dddd1a2b42ab9f8cc500e718ce0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:04.626867 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.645754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1185/2346] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:04.647319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.650319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.663048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:04.663298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca53c9e6-3332-4194-bf8e-5bc3020582c2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.670244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.671608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.671887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.672159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] PATH_INFO: `/v3/projects/cc98eb70df124fe583f96ca80cc93c7c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.673500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cc98eb70df124fe583f96ca80cc93c7c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.675501 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.729036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cc98eb70df124fe583f96ca80cc93c7c', 'request_id': 'req-a1339ee0-df63-41e1-ae74-cfe0dad54f51'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.734188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1162/2347] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:04.738500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.747530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cc98eb70df124fe583f96ca80cc93c7c', 'request_id': 'req-a1339ee0-df63-41e1-ae74-cfe0dad54f51'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.748381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01131b34-4a02-48bb-84d3-e5d41132c2a4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.753803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cc98eb70df124fe583f96ca80cc93c7c', 'request_id': 'req-a1339ee0-df63-41e1-ae74-cfe0dad54f51'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.766040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] The token cache is being invalidate because project cc98eb70df124fe583f96ca80cc93c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:04.766424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.769578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:04.771472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1186/2348] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:04 2022] DELETE /identity/v3/projects/cc98eb70df124fe583f96ca80cc93c7c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:04.772459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.773820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.825973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.826604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.827077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.827471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.828163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:12:04.829224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.831207 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aac765-cb72-4cf2-bb4f-2839b12be411 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.862381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1163/2349] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:12:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:12:04.862381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.863390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.863682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.865996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1339ee0-df63-41e1-ae74-cfe0dad54f51 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.883395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.883395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.883968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.883968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.885770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.894245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:04.895387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.904173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1164/2350] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:04.904784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:04.907788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:04.937352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0cd6b-dbc7-4045-aadb-94f42ffab74f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:04.954882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:04.956111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.956607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.957081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.957995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.960271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.963651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:04.965231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25731a7-8cf0-4cfd-98a3-0a69b1001c5c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:04.975531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1187/2351] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:04 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:04.976961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:04.977550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:04.977841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:04.988631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:04.993739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1165/2352] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/projects => generated 363 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:04.997741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.001649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:05.003774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:05.083908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1188/2353] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:05.086113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705ad235-ee62-4260-aa07-4082afdf3a6c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.088283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.098160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b42971-1746-4cf1-be11-28408f89a593 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.105361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.106414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.106740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.107019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.108287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:12:05.108287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.110916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.111409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.111602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.115144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.115500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.116798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.123816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.128441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1189/2354] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:12:05.133051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.150045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b4422d-4678-430f-bd78-3579183d4ed2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.158502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.159316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.159866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.160232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.161570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.164163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.185995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1166/2355] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:04 2022] POST /identity/v3/users => generated 282 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:05.188437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.212030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d66a38-8639-4339-b908-391efb0bf5ef admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.225955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1190/2356] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:05 2022] POST /identity/v3/projects => generated 389 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:05.227326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.227652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.230082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.230924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.232265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.233030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.234657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580960b0-dd96-4759-b378-4867a64eb86c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.236507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:05.248431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1167/2357] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:05.250403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.250694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.250970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.273616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:05.274671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:05.375162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1168/2358] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:12:05 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:05.375771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.378225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f88d84-254e-4f59-812e-e2dae1199a6e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.386938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.388014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.388866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.390337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.391372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.393782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.407792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e039fd3-f18b-44e3-868d-0186a2ced18f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.424300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.425057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.425360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.425629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.426275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.427855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.431559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1191/2359] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:05 2022] POST /identity/v3/users => generated 295 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:05.436684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.438506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:05.443994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1169/2360] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:05.443994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.457154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ad6b40-24f8-4724-a599-9387c0f9aa09 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.469878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.470519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.470798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.471075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.472002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.473701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.488042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1170/2361] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:05.489066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.500709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fd64d4-a574-4bf4-a06f-171dbb1c9bb2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.506978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.507784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.508133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.508577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] PATH_INFO: `/v3/projects/7b12753e0cc84c0d98ca510daab4986c/users/21e1bad6dd614f0f8cdd356ecdddb311/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.538399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b12753e0cc84c0d98ca510daab4986c, user_id=21e1bad6dd614f0f8cdd356ecdddb311, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.541222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.574548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1171/2362] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:05 2022] PUT /identity/v3/projects/7b12753e0cc84c0d98ca510daab4986c/users/21e1bad6dd614f0f8cdd356ecdddb311/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:05.575612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.589690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:05.600438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00719f80-dfe5-40e0-9f46-65650370e7d9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.674591 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513973f9-4dd4-4cac-a4a9-7e0d2ef701ca admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.678416 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.679152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.679558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.679944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.680783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.681604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.681958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.682361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.683030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.684713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8651795e-edb1-48d4-b235-b876217657c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.696823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1172/2363] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:05.698363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.698756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.699298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.735129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] MFA Rules not processed for user `21e1bad6dd614f0f8cdd356ecdddb311`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:05.737370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:05.754564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.756316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.766865 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1192/2364] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:05.768028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.783350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba7210d-02f0-45e7-a621-c9d2150b6130 service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:05.790568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:05.792008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.792597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.792885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] PATH_INFO: `/v3/projects/f11777beaedf4d6fb3b07a78b5aa2a6f/users/1c390812681948098b7aefff1336169d/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.816925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f11777beaedf4d6fb3b07a78b5aa2a6f, user_id=1c390812681948098b7aefff1336169d, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:05.829209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:05.833704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da60714-ccd2-4b99-9a15-02be11434810 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:05.866414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1193/2365] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:05 2022] PUT /identity/v3/projects/f11777beaedf4d6fb3b07a78b5aa2a6f/users/1c390812681948098b7aefff1336169d/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:05.877930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:05.878221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:05.879098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:05.890616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1173/2366] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:05.898278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:05.917859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] MFA Rules not processed for user `1c390812681948098b7aefff1336169d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:05.919516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:05.988244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a3b1c7-8594-40b5-9cfc-4147fbd7d447 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:06.057237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1194/2367] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:05 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:06.059754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:06.060909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:06.061644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:06.062162 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:06.076498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:06.078063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:06.100277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cac6fd-67c9-4e4a-9aeb-4ca9efae0cec None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:06.114249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:06.114893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:06.115176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:06.115451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:06.124201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:06.127033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:06.128887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:06.141989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1195/2368] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:06 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:12:06.157729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:06.160144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:06.174528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1174/2369] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:07.157111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:07.166352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b2d97-792b-475c-bf00-06bcdaefb188 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:07.179508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:07.180402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:07.180848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:07.181306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:07.187181 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:07.304808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:07.308914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:07.320843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1196/2370] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:08.737830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:08.761395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7814b77b-524f-461b-9e47-b279b2e4c359 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:08.767240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:08.769073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:08.770495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:08.770888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:08.772896 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:08.897312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:08.941434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:08.941434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:08.956954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1175/2371] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:08 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:13.508765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:13.512221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:13.658763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038fc58-9fe9-44e8-a148-d71248d5a809 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:13.675618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:13.676280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:13.676722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:13.677370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:13.681943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:13.735024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:13.736962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:13.833808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:13.835525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2087be0-87f6-4312-a75d-12c856fb0714 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:13.840816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed0e5d-0717-4ad0-a609-68b7b82e58e2 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:13.849998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1197/2372] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:13.867185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:13.867850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:13.868866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:13.869163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] PATH_INFO: `/v3/users/6ed9b28855454791a520b9b280764c1d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:13.870499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ed9b28855454791a520b9b280764c1d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:13.872473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:13.976054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ed9b28855454791a520b9b280764c1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:13.993371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ed9b28855454791a520b9b280764c1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:14.021629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ed9b28855454791a520b9b280764c1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:14.023476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ed9b28855454791a520b9b280764c1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:14.037481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ed9b28855454791a520b9b280764c1d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:14.060780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1176/2373] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:13 2022] DELETE /identity/v3/users/6ed9b28855454791a520b9b280764c1d => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:12:14.065054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:14.065722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:14.066294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:14.096131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:14.097424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:14.164629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:14.194890 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1198/2374] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:14.211392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:14.213151 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:14.355445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985d4db3-3f13-4a39-95e4-de532111746e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:14.359953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:14.360662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:14.360940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:14.361234 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:14.373120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:14.376785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:14.398783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1177/2375] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:12:15.522351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:15.526748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:15.568986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c10fcd7-9e8c-424b-bdcc-beac7034b91e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:15.578657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:15.578657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:15.578657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:15.579041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] PATH_INFO: `/v3/projects/34de750642154b7aa42e09807e421622` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:15.580118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34de750642154b7aa42e09807e421622)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:15.582444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:15.711921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34de750642154b7aa42e09807e421622', 'request_id': 'req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:15.725888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34de750642154b7aa42e09807e421622', 'request_id': 'req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:15.734947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34de750642154b7aa42e09807e421622', 'request_id': 'req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:15.753112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] The token cache is being invalidate because project 34de750642154b7aa42e09807e421622 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:15.755359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:15.757249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:15.768911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1199/2376] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:15 2022] DELETE /identity/v3/projects/34de750642154b7aa42e09807e421622 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:15.772991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:15.788169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34011560-4e77-4a3d-8762-1bfdf952d788 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:15.809553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:15.965045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:15.967893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:15.969126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:15.971219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] PATH_INFO: `/v3/users/15d00114b3f64f9f83cdba87fa2bb855` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:15.979736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=15d00114b3f64f9f83cdba87fa2bb855)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:15.982696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:16.127522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '15d00114b3f64f9f83cdba87fa2bb855'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:16.143637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '15d00114b3f64f9f83cdba87fa2bb855'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:16.176533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '15d00114b3f64f9f83cdba87fa2bb855'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:16.177468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '15d00114b3f64f9f83cdba87fa2bb855'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:16.193051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-46171e9f-8984-466a-8445-1d338982afd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '15d00114b3f64f9f83cdba87fa2bb855'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:16.204965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1178/2377] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:15 2022] DELETE /identity/v3/users/15d00114b3f64f9f83cdba87fa2bb855 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:16.984556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:16.987249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:17.008756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3c00c-d6bf-4f6d-a6a5-16084dc2f1a0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:17.212553 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:17.213487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:17.217906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:17.218729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] PATH_INFO: `/v3/projects/7110a4600a2841b496848ad9a5253a9a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:17.221418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7110a4600a2841b496848ad9a5253a9a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:17.228289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:17.314365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:17.314907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:17.315310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:17.376865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:17.385205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:17.407508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7110a4600a2841b496848ad9a5253a9a', 'request_id': 'req-dec418a5-b4ad-40b6-94e9-15ce16da78fc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.439435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7110a4600a2841b496848ad9a5253a9a', 'request_id': 'req-dec418a5-b4ad-40b6-94e9-15ce16da78fc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.464014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7110a4600a2841b496848ad9a5253a9a', 'request_id': 'req-dec418a5-b4ad-40b6-94e9-15ce16da78fc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.491903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:17.516415 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] The token cache is being invalidate because project 7110a4600a2841b496848ad9a5253a9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:17.518830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.520806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.536444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1200/2378] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:16 2022] DELETE /identity/v3/projects/7110a4600a2841b496848ad9a5253a9a => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:17.536444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:17.538262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:17.610492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1179/2379] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:12:17 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:17.615939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:17.618828 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:17.728554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec418a5-b4ad-40b6-94e9-15ce16da78fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:17.729770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:17.742110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:17.743309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:17.745777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:17.746307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] PATH_INFO: `/v3/users/d895dddd1a2b42ab9f8cc500e718ce0e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:17.752351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d895dddd1a2b42ab9f8cc500e718ce0e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:17.759500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:17.818637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3c5c1a-3dac-4720-a887-7fbcafa6a4aa None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:17.834532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:17.835925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:17.836309 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:17.837378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:17.908524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd895dddd1a2b42ab9f8cc500e718ce0e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.910120 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:17.916580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:17.944480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1180/2380] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:12:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:17.960966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd895dddd1a2b42ab9f8cc500e718ce0e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.985851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd895dddd1a2b42ab9f8cc500e718ce0e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:17.986863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd895dddd1a2b42ab9f8cc500e718ce0e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:18.024857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ff834bce-90fc-4f25-a149-4970363d9bb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd895dddd1a2b42ab9f8cc500e718ce0e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:18.041489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1201/2381] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:17 2022] DELETE /identity/v3/users/d895dddd1a2b42ab9f8cc500e718ce0e => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:18.584644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:18.586696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:18.625282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1720f0f2-1c94-4299-bb55-c67e3703606b service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:18.864031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:18.864881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:18.865000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:18.865263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] PATH_INFO: `/v3/users/1c390812681948098b7aefff1336169d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:18.868182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c390812681948098b7aefff1336169d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:18.870206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:19.006263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c390812681948098b7aefff1336169d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.046877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c390812681948098b7aefff1336169d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.083555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c390812681948098b7aefff1336169d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.085134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c390812681948098b7aefff1336169d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.110051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c390812681948098b7aefff1336169d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.119825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1181/2382] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:18 2022] DELETE /identity/v3/users/1c390812681948098b7aefff1336169d => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:12:19.121814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:19.122315 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:19.122398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:19.224195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:19.225911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:19.468195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:19.470152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:19.476143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1202/2383] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:19.522818 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c12449-e1da-4fea-9168-000133fbe849 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:19.542996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:19.547962 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:19.548259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:19.548544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] PATH_INFO: `/v3/projects/bcfa0b2aae65403786587d7a3a1303c8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:19.562535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] RBAC: Authorizing `identity:delete_project(project_id=bcfa0b2aae65403786587d7a3a1303c8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:19.573948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:19.629664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:19.632610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:19.682537 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:19.724006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:19.778854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bcfa0b2aae65403786587d7a3a1303c8', 'request_id': 'req-b297cb91-da8b-4bb9-8195-1608c9023cad'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.811660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadb47b6-71fb-4eeb-8fb8-abcb6bdc3f65 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:19.812500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bcfa0b2aae65403786587d7a3a1303c8', 'request_id': 'req-b297cb91-da8b-4bb9-8195-1608c9023cad'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.827772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bcfa0b2aae65403786587d7a3a1303c8', 'request_id': 'req-b297cb91-da8b-4bb9-8195-1608c9023cad'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.869622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] The token cache is being invalidate because project bcfa0b2aae65403786587d7a3a1303c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:19.869927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.872304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:19.903331 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1182/2384] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:19 2022] DELETE /identity/v3/projects/bcfa0b2aae65403786587d7a3a1303c8 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:19.995281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:19.997755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:19.999145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:20.000548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:20.012903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:20.181098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:20.182598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70886b3-ffd4-493e-b7c2-febea66901f2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:20.204896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1203/2385] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 576 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:21.991281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:21.994240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:22.038722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b297cb91-da8b-4bb9-8195-1608c9023cad admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:22.068069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:22.068069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:22.068578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:22.068940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] PATH_INFO: `/v3/projects/f11777beaedf4d6fb3b07a78b5aa2a6f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:22.073066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f11777beaedf4d6fb3b07a78b5aa2a6f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:22.078762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:22.222202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f11777beaedf4d6fb3b07a78b5aa2a6f', 'request_id': 'req-ac2056be-83ab-484b-bca7-8e6e67f7db09'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:22.249588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f11777beaedf4d6fb3b07a78b5aa2a6f', 'request_id': 'req-ac2056be-83ab-484b-bca7-8e6e67f7db09'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:22.269978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f11777beaedf4d6fb3b07a78b5aa2a6f', 'request_id': 'req-ac2056be-83ab-484b-bca7-8e6e67f7db09'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:22.314108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] The token cache is being invalidate because project f11777beaedf4d6fb3b07a78b5aa2a6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:22.315333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:22.318026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:22.321519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1183/2386] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:21 2022] DELETE /identity/v3/projects/f11777beaedf4d6fb3b07a78b5aa2a6f => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:30.194656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=62 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:32.189005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:32.189642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:32.189642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:32.210079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:32.211287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:32.268720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1204/2387] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:12:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:32.281437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:32.282877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:32.353480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2056be-83ab-484b-bca7-8e6e67f7db09 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:32.358541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:32.359149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:32.359431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:32.359704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:32.367728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:32.369476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:32.379459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1184/2388] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:12:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:34.344886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:34.347568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:34.416535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9a5c40-201c-4331-a3ca-4ab88f9a150d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:34.421241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:34.421874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:34.422154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:34.422428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] PATH_INFO: `/v3/users/323b47371833408db370c4736f4725cc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:34.423563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] RBAC: Authorizing `identity:delete_user(user_id=323b47371833408db370c4736f4725cc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:34.425524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:34.474960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '323b47371833408db370c4736f4725cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.482629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '323b47371833408db370c4736f4725cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.490899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '323b47371833408db370c4736f4725cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.491672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '323b47371833408db370c4736f4725cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.505787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5d375db3-b315-4d15-9cf1-bbbcadf1a106 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '323b47371833408db370c4736f4725cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.512275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1205/2389] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:34 2022] DELETE /identity/v3/users/323b47371833408db370c4736f4725cc => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:34.700517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:34.712230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e520dc9-f6f1-41c4-8d89-b1c353029394 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:34.750007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:34.776899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:34.777488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:34.777770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:34.778056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] PATH_INFO: `/v3/projects/4f897efa130940b68518d721e8c9ef69` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:34.779830 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f897efa130940b68518d721e8c9ef69)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:34.781810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:34.827775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f897efa130940b68518d721e8c9ef69', 'request_id': 'req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.834041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f897efa130940b68518d721e8c9ef69', 'request_id': 'req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.839797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f897efa130940b68518d721e8c9ef69', 'request_id': 'req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.853222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] The token cache is being invalidate because project 4f897efa130940b68518d721e8c9ef69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:34.853513 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.854189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed20e3e5-9fbe-47df-9803-8bbcff1bb64e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:34.855664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1185/2390] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:34 2022] DELETE /identity/v3/projects/4f897efa130940b68518d721e8c9ef69 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:34.860604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:34.860894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:34.861178 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:34.880993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:34.882238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:34.900967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:34.949248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1206/2391] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:34.957483 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:34.957770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:34.958045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:34.978930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:34.980148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:34.988100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1186/2392] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:34.992500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.002562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce90686-b20f-4c60-8095-36e02136f190 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.008775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.009425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.009713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.010014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.010672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:12:35.010979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.012584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.025131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1207/2393] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:12:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:12:35.030469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.039918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab21185-e6dc-462f-8536-517d957cdac3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.045344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.045959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.046241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.046516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.047152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.049040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.076856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1187/2394] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:35 2022] POST /identity/v3/projects => generated 367 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:35.081547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.092325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f8d4b7-3a51-44ba-af90-0a4924efba56 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.149769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.150378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.150660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.150931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.151566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.153528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.176891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1208/2395] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:35 2022] POST /identity/v3/users => generated 284 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:12:35.181214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.192405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331a6fd3-1086-48b6-9817-68de32f9bb37 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.197350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.197974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.198300 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.198524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.199444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.201647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.212433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1188/2396] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:35.216105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.226397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11503db-2ba0-4d53-91aa-29d5ec3f36bf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.231440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.232280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.232565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.232841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.233876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.235671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1633913-1d2b-4922-b692-3386af0f93fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.248618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1209/2397] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:35.252723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.263030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f1506-dea9-4709-9a9b-1d611b8eb325 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.270941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.271816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.272168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.272511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] PATH_INFO: `/v3/projects/a349d76cdfae42198a4b711ee3d238dc/users/b6fe00f5f2874cbb9665d37074375999/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.294084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a349d76cdfae42198a4b711ee3d238dc, user_id=b6fe00f5f2874cbb9665d37074375999, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.297292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.311220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1189/2398] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:35 2022] PUT /identity/v3/projects/a349d76cdfae42198a4b711ee3d238dc/users/b6fe00f5f2874cbb9665d37074375999/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:35.321453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ae66-6d3f-491e-902f-63834f8a0f33 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.321735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ae66-6d3f-491e-902f-63834f8a0f33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.322006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a7ae66-6d3f-491e-902f-63834f8a0f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.351925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-97a7ae66-6d3f-491e-902f-63834f8a0f33 None None] MFA Rules not processed for user `b6fe00f5f2874cbb9665d37074375999`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:35.353137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-97a7ae66-6d3f-491e-902f-63834f8a0f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:35.420676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1210/2399] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:35.432463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:35.434211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:35.491493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7f25be-7e7b-4e9f-8c0f-cf623af661b0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:35.495173 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:35.495776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:35.496076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:35.496334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:35.505317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:35.506912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f2d1b0-fbcd-4998-b3dc-484a5e79c0d8 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:35.516632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1190/2400] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:35 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:37.629594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:37.630301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:37.630301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:37.631544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1211/2401] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:12:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:12:37.637536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1fde-d60f-4722-89ec-90f28312a3bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:37.638011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1fde-d60f-4722-89ec-90f28312a3bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:37.638272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903f1fde-d60f-4722-89ec-90f28312a3bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:37.647185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:37.666371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-903f1fde-d60f-4722-89ec-90f28312a3bd None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:37.667612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-903f1fde-d60f-4722-89ec-90f28312a3bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:37.741354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1191/2402] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:12:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:44.397995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:44.399868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:44.415941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12994356-5d71-40c8-bdbb-6c1e7be926a8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:44.420558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:44.421236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.421529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.421934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.433999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:44.435427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b631b4-0ba4-4c14-b085-8d96409eef1b service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:44.446866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1212/2403] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:44.522138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.522756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.522756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.524023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1192/2404] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 01 05:12:44.528660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e9f6-f051-493b-9794-048315beb321 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.528949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e9f6-f051-493b-9794-048315beb321 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.529278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d9e9f6-f051-493b-9794-048315beb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.543774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:44.550209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-37d9e9f6-f051-493b-9794-048315beb321 None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:44.551413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-37d9e9f6-f051-493b-9794-048315beb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:44.609776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1213/2405] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:12:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:44.622787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:44.625287 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:44.638282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cade6d0-59b5-4fb5-add2-95d1a13bf4f7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:44.641911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:44.642497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.642803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.643077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.650338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:44.651744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57201118-2aeb-4806-8481-c7f65cffa30f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:44.659653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1193/2406] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:44.750491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017087-9955-417a-86c3-e0013e143c52 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.750845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017087-9955-417a-86c3-e0013e143c52 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.751195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91017087-9955-417a-86c3-e0013e143c52 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.752965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1214/2407] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:12:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:12:44.758674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff402-6011-4335-886e-9a2239d0ab1d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.759054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff402-6011-4335-886e-9a2239d0ab1d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.759404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83aff402-6011-4335-886e-9a2239d0ab1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.779645 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-83aff402-6011-4335-886e-9a2239d0ab1d None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:44.781116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-83aff402-6011-4335-886e-9a2239d0ab1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:44.807824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1194/2408] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:12:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:44.819255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017087-9955-417a-86c3-e0013e143c52 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:44.821008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-91017087-9955-417a-86c3-e0013e143c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:44.835822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91017087-9955-417a-86c3-e0013e143c52 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:44.839339 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:44.839936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:44.840212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:44.840476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:44.851807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:44.853383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:44.865637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1215/2409] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:44 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:47.460784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:47.461273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:47.461368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:47.480600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:47.481810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:47.538978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1195/2410] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:12:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:47.551187 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:47.552573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:47.627032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cefc279-c3ef-47b9-9297-49314e47cbdd service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:47.631958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:47.632559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:47.632835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:47.633101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:47.641694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:47.643725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c8e282-190a-49a2-a4ec-917dda59a91e service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:47.654096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1216/2411] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:12:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:12:54.139229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:54.140668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:54.205096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b98cbc-4655-4ecb-a635-d2e530eb9f40 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:54.209547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:54.210168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:54.210446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:54.210721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] PATH_INFO: `/v3/users/21e1bad6dd614f0f8cdd356ecdddb311` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:54.211853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] RBAC: Authorizing `identity:delete_user(user_id=21e1bad6dd614f0f8cdd356ecdddb311)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:54.213859 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:54.238379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:54.268768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21e1bad6dd614f0f8cdd356ecdddb311'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.276915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21e1bad6dd614f0f8cdd356ecdddb311'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.292821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21e1bad6dd614f0f8cdd356ecdddb311'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.293616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21e1bad6dd614f0f8cdd356ecdddb311'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.304628 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21e1bad6dd614f0f8cdd356ecdddb311'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.314928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1196/2412] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:54 2022] DELETE /identity/v3/users/21e1bad6dd614f0f8cdd356ecdddb311 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:54.316545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:54.317058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:54.317160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:54.337075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:54.338335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:54.402284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1217/2413] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:54.413419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:54.414890 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:54.491504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78b5459-47e1-4295-837b-d45f37f74466 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:54.496174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:54.496797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:54.497073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:54.497385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:54.506797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:54.508408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5e91ee-0ccc-48f3-8e54-dbc9d438e9a5 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:54.519840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1197/2414] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:54.809666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:54.811613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:54.833744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf44aa8-6227-4fa3-9bea-3191835b3e27 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:54.838892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:54.839582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:54.839863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:54.840143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] PATH_INFO: `/v3/projects/7b12753e0cc84c0d98ca510daab4986c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:54.841350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b12753e0cc84c0d98ca510daab4986c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:54.844572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:54.878708 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:54.906002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b12753e0cc84c0d98ca510daab4986c', 'request_id': 'req-cf06a03a-2d34-4124-b343-449a82ff612e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.915485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b12753e0cc84c0d98ca510daab4986c', 'request_id': 'req-cf06a03a-2d34-4124-b343-449a82ff612e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.922010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b12753e0cc84c0d98ca510daab4986c', 'request_id': 'req-cf06a03a-2d34-4124-b343-449a82ff612e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.932937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] The token cache is being invalidate because project 7b12753e0cc84c0d98ca510daab4986c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:54.933250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.933896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf06a03a-2d34-4124-b343-449a82ff612e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:54.935373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1218/2415] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:54 2022] DELETE /identity/v3/projects/7b12753e0cc84c0d98ca510daab4986c => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:54.941068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:54.941387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:54.941670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:54.961570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:54.962777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:55.026042 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1198/2416] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:12:55.034552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.034843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.035153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.055841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:55.057025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:55.065261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1219/2417] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:55.069322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.079041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d41fa-684c-4eb4-b0dd-fc231d648d66 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.084214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.084822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.085939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.086221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.086879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:12:55.087187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.088971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.104799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1199/2418] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:12:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:12:55.106131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.116200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e4bbe-ace9-4b38-9430-6ed2ba9f4c53 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.121464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.122068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.122348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.122630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.123273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.125436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.155979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1220/2419] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:12:55 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:12:55.160512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.171806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5f7807-e187-45a0-a2e9-e150fdb5f208 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.202942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:55.250520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.251146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.251441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.251809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.252526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.254922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.285131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1200/2420] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:12:55 2022] POST /identity/v3/users => generated 287 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:12:55.288940 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.304618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79881e52-386c-4bd6-9689-a70f643d0661 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.316770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.317524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.317975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.318359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.319563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.321402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.333232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1221/2421] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:55.336327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.349326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65868a0-f9c6-4883-b409-da19fd5897d1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.354524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.355114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.355457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.355707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.356738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.358459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4eb8ef-da6d-4877-b4e0-9e13f59e48ef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.374504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1201/2422] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:12:55 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:12:55.375651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.392307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7249f64-a9c7-4cc3-913a-ccd9ec6f601c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.408383 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.409344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.409805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.410442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] PATH_INFO: `/v3/projects/ca45695bd65a4753859ada69b13fdfc9/users/696bfb4ff4f4464f830c8d63293ef392/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.430879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca45695bd65a4753859ada69b13fdfc9, user_id=696bfb4ff4f4464f830c8d63293ef392, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.434748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.453704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1222/2423] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:12:55 2022] PUT /identity/v3/projects/ca45695bd65a4753859ada69b13fdfc9/users/696bfb4ff4f4464f830c8d63293ef392/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:55.461857 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.462149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.462429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.491935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] MFA Rules not processed for user `696bfb4ff4f4464f830c8d63293ef392`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:55.493144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:55.556939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1202/2424] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:55.569254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.570969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:55.630092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4c3cae-afbf-4e13-94d5-79797689b801 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.633737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.634473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.634750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.635017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.643783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.645274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704f5be3-70f4-44d9-b8e4-bd854f3d13cf service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.654029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1223/2425] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:55 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:55.697061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.774844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80690f72-e623-4a00-97e3-9a1710354d43 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:55.781509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:55.782346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.782774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.783059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] PATH_INFO: `/v3/users/696bfb4ff4f4464f830c8d63293ef392` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.785068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] RBAC: Authorizing `identity:delete_user(user_id=696bfb4ff4f4464f830c8d63293ef392)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:55.787925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:55.838916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:55.845395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696bfb4ff4f4464f830c8d63293ef392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:55.853985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696bfb4ff4f4464f830c8d63293ef392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:55.866131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696bfb4ff4f4464f830c8d63293ef392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:55.866901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696bfb4ff4f4464f830c8d63293ef392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:55.874488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696bfb4ff4f4464f830c8d63293ef392'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:55.880345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1203/2426] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:12:55 2022] DELETE /identity/v3/users/696bfb4ff4f4464f830c8d63293ef392 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:12:55.884696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:55.884978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:55.885307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:55.904252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:12:55.905528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:55.954534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:12:55.967406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1224/2427] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:12:55.977140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:55.978554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:56.036070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e7b7cb-f41a-4322-a71a-60b01814d23d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:56.039719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:56.040321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:56.040601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:56.040874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:56.049792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:56.051192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:56.060877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1204/2428] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:12:56.354182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:12:56.355825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:12:56.368401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc048d90-aa41-4a1e-80ad-2078b9285ee0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:12:56.374051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:12:56.375125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:12:56.375558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:12:56.376067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] PATH_INFO: `/v3/projects/ca45695bd65a4753859ada69b13fdfc9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:12:56.377618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca45695bd65a4753859ada69b13fdfc9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:12:56.380023 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:12:56.448466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca45695bd65a4753859ada69b13fdfc9', 'request_id': 'req-aa49b6c1-5489-4667-94d2-15935d8f6f84'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:56.457637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca45695bd65a4753859ada69b13fdfc9', 'request_id': 'req-aa49b6c1-5489-4667-94d2-15935d8f6f84'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:56.463802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca45695bd65a4753859ada69b13fdfc9', 'request_id': 'req-aa49b6c1-5489-4667-94d2-15935d8f6f84'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:56.475946 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] The token cache is being invalidate because project ca45695bd65a4753859ada69b13fdfc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:12:56.476235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:56.476904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:12:56.478463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1225/2429] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:12:56 2022] DELETE /identity/v3/projects/ca45695bd65a4753859ada69b13fdfc9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:13:03.172917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:03.174541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:03.252831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d66d5be4-af42-4789-8bb9-dcb7de4ef0ea service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:03.320407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:03.321026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:03.321360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:03.321614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:03.323910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:03.333590 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:03.338945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:03.341289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee494dd-2142-4b68-b824-854647c6d64f service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:03.353363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1205/2430] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:13:04.180304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:04.180304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:04.266674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa49b6c1-5489-4667-94d2-15935d8f6f84 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:04.275632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:04.276371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:04.276755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:04.277252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] PATH_INFO: `/v3/users/b6fe00f5f2874cbb9665d37074375999` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:04.278958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6fe00f5f2874cbb9665d37074375999)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:04.282400 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:04.339827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6fe00f5f2874cbb9665d37074375999'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.361211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6fe00f5f2874cbb9665d37074375999'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.361211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6fe00f5f2874cbb9665d37074375999'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.361211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6fe00f5f2874cbb9665d37074375999'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.377057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6fe00f5f2874cbb9665d37074375999'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.378886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:04.388750 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1226/2431] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:13:04 2022] DELETE /identity/v3/users/b6fe00f5f2874cbb9665d37074375999 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:13:04.394181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:04.394660 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:04.394774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:04.414724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:04.415934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:04.479124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1206/2432] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:13:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:04.489648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:04.491094 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:04.549555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dece818a-e131-45f3-b562-b01f3bfdd2eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:04.553349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:04.553955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:04.554290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:04.554588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:04.565249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:04.566783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a26a59b-013f-437b-9093-6ab6ccb519bc service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:04.576011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1227/2433] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:13:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:13:04.842701 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:04.844199 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:04.857259 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4dccc-8ceb-4919-b848-930f4c75c126 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:04.863229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:04.863864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:04.864141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:04.864419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] PATH_INFO: `/v3/projects/a349d76cdfae42198a4b711ee3d238dc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:04.865580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a349d76cdfae42198a4b711ee3d238dc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:04.867502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:04.914320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a349d76cdfae42198a4b711ee3d238dc', 'request_id': 'req-dfd78c29-894f-450a-b8d9-202a72f6d80b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.920568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a349d76cdfae42198a4b711ee3d238dc', 'request_id': 'req-dfd78c29-894f-450a-b8d9-202a72f6d80b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.926077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a349d76cdfae42198a4b711ee3d238dc', 'request_id': 'req-dfd78c29-894f-450a-b8d9-202a72f6d80b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.939594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] The token cache is being invalidate because project a349d76cdfae42198a4b711ee3d238dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:13:04.940239 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.940938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:13:04.942851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1207/2434] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:13:04 2022] DELETE /identity/v3/projects/a349d76cdfae42198a4b711ee3d238dc => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:13:07.819771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948422cf-5a3a-4d66-b33b-fb1809377406 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:07.820261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948422cf-5a3a-4d66-b33b-fb1809377406 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:07.820357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948422cf-5a3a-4d66-b33b-fb1809377406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:07.842297 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-948422cf-5a3a-4d66-b33b-fb1809377406 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:07.843773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-948422cf-5a3a-4d66-b33b-fb1809377406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:07.899869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1228/2435] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:13:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:07.912843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:13:07.914270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:07.986270 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd78c29-894f-450a-b8d9-202a72f6d80b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:13:07.991324 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:13:07.991936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:07.992219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:07.992499 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:08.002095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:13:08.003704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b083d96c-ac22-464a-a53e-625bd2954e34 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:13:08.011869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1208/2436] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:13:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:13:17.893045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=52 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:18.008588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:21.227516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7b3c-f9bb-423e-8ee2-95778aa74727 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:21.228026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7b3c-f9bb-423e-8ee2-95778aa74727 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:21.228124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b7b3c-f9bb-423e-8ee2-95778aa74727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:21.247151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a46b7b3c-f9bb-423e-8ee2-95778aa74727 None None] MFA Rules not processed for user `5ed5cf12b4354c7d88fe6e69f15cf335`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:21.248365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a46b7b3c-f9bb-423e-8ee2-95778aa74727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:21.300771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1229/2437] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:13:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:13:31.293844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=25 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:13:55.427306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:13:55.427881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:13:55.427881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:13:55.447119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] MFA Rules not processed for user `386e1605489846248e898a62c79643fe`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:13:55.448311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:13:55.503318 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1209/2438] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:13:55 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:05.496435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=25 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:12.785170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26959ef8-db19-4420-b29e-13613bdc35ed None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:12.786039 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26959ef8-db19-4420-b29e-13613bdc35ed None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:12.786494 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26959ef8-db19-4420-b29e-13613bdc35ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:12.812121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-26959ef8-db19-4420-b29e-13613bdc35ed None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:12.813395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-26959ef8-db19-4420-b29e-13613bdc35ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:12.820749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1230/2439] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:14:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:12.885428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:12.898288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538b22c8-44fd-49c9-9654-72d31770fa6b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:12.908036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:12.908611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:12.909113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:12.909629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:12.921370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:12.922987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:12.939335 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1210/2440] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:14:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:14:14.201800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:14.202959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:14.203244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:14.224382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] MFA Rules not processed for user `6efb292e19dc445b9b01e455fa2befec`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:14.225648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:14.302084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1231/2441] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:14 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:22.214117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:22.215869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:22.283553 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03af26-cfc7-4105-a801-14e5d725fde5 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:22.288528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:22.289299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:22.289750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:22.290203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] PATH_INFO: `/v3/users/62d11a74dcb3419eb119f8771bfc9cf6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:22.291622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62d11a74dcb3419eb119f8771bfc9cf6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:22.294038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:22.343792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62d11a74dcb3419eb119f8771bfc9cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.350961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62d11a74dcb3419eb119f8771bfc9cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.362739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62d11a74dcb3419eb119f8771bfc9cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.363442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62d11a74dcb3419eb119f8771bfc9cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.371031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62d11a74dcb3419eb119f8771bfc9cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.377624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1211/2442] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:14:22 2022] DELETE /identity/v3/users/62d11a74dcb3419eb119f8771bfc9cf6 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:22.559513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:22.571733 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4601d30a-bc68-4d8b-a38a-1963323c5387 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:22.635569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:22.636206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:22.636486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:22.636760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] PATH_INFO: `/v3/projects/24924e0862684d4787a5d3f932907651` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:22.637907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=24924e0862684d4787a5d3f932907651)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:22.640425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:22.693073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24924e0862684d4787a5d3f932907651', 'request_id': 'req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.700570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24924e0862684d4787a5d3f932907651', 'request_id': 'req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.706717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24924e0862684d4787a5d3f932907651', 'request_id': 'req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.718828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] The token cache is being invalidate because project 24924e0862684d4787a5d3f932907651 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:14:22.719117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.719761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.721268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1232/2443] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:14:22 2022] DELETE /identity/v3/projects/24924e0862684d4787a5d3f932907651 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:22.725292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:22.726852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:22.739909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a05895b-dbbb-4c0a-82ca-446df635a708 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:22.798430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:22.799073 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:22.799356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:22.799634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] PATH_INFO: `/v3/users/3444b6b8c75c4465842d3333244dd6ce` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:22.800777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3444b6b8c75c4465842d3333244dd6ce)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:22.802761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:22.808010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:22.853547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3444b6b8c75c4465842d3333244dd6ce'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.861595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3444b6b8c75c4465842d3333244dd6ce'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.874874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3444b6b8c75c4465842d3333244dd6ce'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.875612 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3444b6b8c75c4465842d3333244dd6ce'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.887220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3444b6b8c75c4465842d3333244dd6ce'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:22.893389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1212/2444] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:14:22 2022] DELETE /identity/v3/users/3444b6b8c75c4465842d3333244dd6ce => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:23.068314 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:23.069871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:23.084154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063e662-a4cc-4a2d-8e98-b8ad449e89ca admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:23.115007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:23.147509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:23.148167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:23.148473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:23.148748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] PATH_INFO: `/v3/projects/c448d57f3a8243bbbfa8442c2559e33f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:23.150014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c448d57f3a8243bbbfa8442c2559e33f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:23.152036 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:23.197365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c448d57f3a8243bbbfa8442c2559e33f', 'request_id': 'req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:23.204536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c448d57f3a8243bbbfa8442c2559e33f', 'request_id': 'req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:23.210108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c448d57f3a8243bbbfa8442c2559e33f', 'request_id': 'req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:23.221063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] The token cache is being invalidate because project c448d57f3a8243bbbfa8442c2559e33f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:14:23.221382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:23.222033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:23.223504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1233/2445] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:14:23 2022] DELETE /identity/v3/projects/c448d57f3a8243bbbfa8442c2559e33f => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:31.851924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:31.853550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:31.873258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17588ac-52c9-4f6b-bdd6-74674f4fc46e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:31.930009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:31.930653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:31.930933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:31.931211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] PATH_INFO: `/v3/users/5ed5cf12b4354c7d88fe6e69f15cf335` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:31.932376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ed5cf12b4354c7d88fe6e69f15cf335)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:31.934345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:31.981993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ed5cf12b4354c7d88fe6e69f15cf335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:31.988946 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ed5cf12b4354c7d88fe6e69f15cf335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.001100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ed5cf12b4354c7d88fe6e69f15cf335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.001810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ed5cf12b4354c7d88fe6e69f15cf335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.009123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ed79a652-954e-4d49-ab50-a2d3984ecc6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ed5cf12b4354c7d88fe6e69f15cf335'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.015538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1213/2446] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:14:31 2022] DELETE /identity/v3/users/5ed5cf12b4354c7d88fe6e69f15cf335 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:32.194461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.196049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:32.214896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ab6ed-a715-4f94-95fb-7618e5ac8e67 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.273062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.273748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.274031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.274304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] PATH_INFO: `/v3/projects/712a1f97325f4f0299e99ac544a8f3aa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.275425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=712a1f97325f4f0299e99ac544a8f3aa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.277366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.323010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '712a1f97325f4f0299e99ac544a8f3aa', 'request_id': 'req-83112530-37b9-4a4e-a151-9b1ad62a08f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.329374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '712a1f97325f4f0299e99ac544a8f3aa', 'request_id': 'req-83112530-37b9-4a4e-a151-9b1ad62a08f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.333207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:32.335564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '712a1f97325f4f0299e99ac544a8f3aa', 'request_id': 'req-83112530-37b9-4a4e-a151-9b1ad62a08f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.348407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] The token cache is being invalidate because project 712a1f97325f4f0299e99ac544a8f3aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:14:32.348698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.349380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-83112530-37b9-4a4e-a151-9b1ad62a08f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:14:32.350856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1234/2447] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:14:32 2022] DELETE /identity/v3/projects/712a1f97325f4f0299e99ac544a8f3aa => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:32.356112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.356398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.356781 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.366130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:32.380043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:32.381783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:32.441904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1214/2448] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:32.449878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.450165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.450441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.471596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:32.472895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:32.480706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1235/2449] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:32.486417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.495099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5605df08-1319-4309-93e8-7fa5365e9fc2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.499842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.500434 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.500708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.500977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.501646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:14:32.501943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.503510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.515804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1215/2450] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:14:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:14:32.520282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.529455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec778b44-87b9-40c9-9546-d296e58a58f5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.534966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.535564 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.535846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.536128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.536755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.538730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.566233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1236/2451] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:14:32 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:14:32.570478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.581054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738a237a-c5af-4ed8-8421-c77b2a6d055e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.636146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.636743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.637027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.637343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.637968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.640886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.662104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1216/2452] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:14:32 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:14:32.666224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.676579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3dd300-0491-4b38-9d86-baabb02e6192 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.681286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.681874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.682153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.682426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.683066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.684652 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.694949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1237/2453] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:14:32.698767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.709441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c779cde5-616d-4bf7-a590-1af188d56d02 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.714297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.714886 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.715165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.715439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.716099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.717844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63908668-743a-45e3-97d2-9ac06284b109 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.728181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1217/2454] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:14:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:14:32.732184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.742064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14274b9-a72a-4d48-85cb-49e58514f0f4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.746739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.747390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.747670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.747947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] PATH_INFO: `/v3/projects/cdd618eb561c486f954be396d6218b3e/users/80f428660fa3422ca82645b53c7ea2dc/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.763430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdd618eb561c486f954be396d6218b3e, user_id=80f428660fa3422ca82645b53c7ea2dc, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.766915 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.780992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1238/2455] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:14:32 2022] PUT /identity/v3/projects/cdd618eb561c486f954be396d6218b3e/users/80f428660fa3422ca82645b53c7ea2dc/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:14:32.786074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09bf2-755f-46f8-9cd6-433fdb2faf57 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.786358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09bf2-755f-46f8-9cd6-433fdb2faf57 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.786635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af09bf2-755f-46f8-9cd6-433fdb2faf57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.804996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1af09bf2-755f-46f8-9cd6-433fdb2faf57 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:32.806208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1af09bf2-755f-46f8-9cd6-433fdb2faf57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:32.864856 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1218/2456] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:32.875477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:32.877206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:32.935738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5c46b9-96aa-4675-b638-3d671691b439 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:32.940047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:32.940646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:32.940929 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:32.941226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:32.951148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:32.952665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:32.962018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1239/2457] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:14:36.974022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed20-3172-4cc9-9805-bc00adfc3f01 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:36.974592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed20-3172-4cc9-9805-bc00adfc3f01 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:36.974592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aed20-3172-4cc9-9805-bc00adfc3f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:36.998869 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:37.007044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c60aed20-3172-4cc9-9805-bc00adfc3f01 None None] MFA Rules not processed for user `80f428660fa3422ca82645b53c7ea2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:37.009135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c60aed20-3172-4cc9-9805-bc00adfc3f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:37.085283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1219/2458] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:36 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:37.100348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:37.101819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:37.181666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06390bab-fbaa-4029-87f4-8fb93a7ea4c3 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:37.189826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:37.190474 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:37.190751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:37.191024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:37.199253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:37.201083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:37.211278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1240/2459] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:38.565150 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:38.565863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:38.565863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:38.585523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] MFA Rules not processed for user `80f428660fa3422ca82645b53c7ea2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:14:38.586757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:38.594540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1220/2460] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:14:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:14:47.206747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=1,keystone:SELECT=91,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:48.579752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=30 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:14:51.936481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:51.938215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:51.953853 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573b190f-3209-479f-9bfd-53264bf6c97a service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:51.957511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:51.958116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:51.958391 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:51.958662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:51.960474 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:51.975576 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:51.977004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fef76d-ad70-4fa8-8537-238e441b351f service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:51.989049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1241/2461] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:51 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:14:53.179319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:14:53.189146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac6022c-2d80-4e9b-851f-957f84b1b017 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:14:53.194512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:14:53.195121 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:14:53.195395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:14:53.195662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:14:53.197488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:14:53.211846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:14:53.213545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:14:53.225036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1221/2462] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:14:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:01.983251 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:03.220124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:04.009589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:04.010177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:04.010177 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:04.030011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:04.031216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:04.087296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1242/2463] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:15:04 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:04.099664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:04.101107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:04.168607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5280a2b8-1c5b-4c9e-988d-602d0db7af76 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:04.173649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:04.174250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:04.174527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:04.174799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:04.182730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:04.184289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:04.192944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1222/2464] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:15:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:09.856730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:09.870716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0c4a1-fbd9-4b76-b978-f0b2a0b87e20 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:09.880782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:09.881562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:09.881911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:09.882335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:09.884407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:09.977205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:09.978852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:09.992910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1243/2465] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:09 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:14.189775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=32 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:14.797088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:14.799166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:14.854925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e501c00b-715a-4ce3-bbcd-7c8e16127b8e service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:14.858582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:14.859183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:14.859457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:14.859727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:14.862206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:14.920652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:14.922247 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:14.932910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1223/2466] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:14 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:18.540535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:18.541996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:18.610237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebfbed3-e2ec-4208-ba7c-0057988b7677 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:18.615692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:18.616301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:18.616582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:18.616856 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:18.618642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:18.630345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:18.631945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55e3c-f6dc-4ba5-9318-3e1bad650d20 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:18.642213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1244/2467] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:20.091126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:20.101117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c5e6-e480-4d5f-845d-590a0e547eaa service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:20.104731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:20.105357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:20.105635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:20.105909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:20.107772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:20.118504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:20.119918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:20.129340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1224/2468] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:21.236715 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:21.237323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:21.237323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:21.257757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:21.259006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:21.268306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1245/2469] 10.222.0.43 () {58 vars in 1009 bytes} [Thu Sep 1 05:15:21 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:21.283006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:21.299775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f9544b-5fb0-49cd-9409-2cb2f45c0d3f service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:21.304807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:21.305600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:21.305939 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:21.306209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:21.317598 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:21.319255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:21.341399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1225/2470] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:15:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:25.926444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:25.936305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d2e0-16f5-45ab-ad59-456a240fd22b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:25.940213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:25.940831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:25.941109 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:25.941413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:25.943242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:25.956117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:25.957677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:25.968274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1246/2471] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:30.099143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.100599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:30.116605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5110b6b0-b657-4248-a520-c8d87bcda584 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.122114 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.122779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.123057 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.123327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] PATH_INFO: `/v3/users/6efb292e19dc445b9b01e455fa2befec` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.124465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6efb292e19dc445b9b01e455fa2befec)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.126780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.178171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6efb292e19dc445b9b01e455fa2befec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.185005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6efb292e19dc445b9b01e455fa2befec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.197154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6efb292e19dc445b9b01e455fa2befec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.197844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6efb292e19dc445b9b01e455fa2befec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.206974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5ecd54f6-6155-4a34-a7be-a7ce2af77c51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6efb292e19dc445b9b01e455fa2befec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.209248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.214671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1226/2472] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:30 2022] DELETE /identity/v3/users/6efb292e19dc445b9b01e455fa2befec => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:30.387325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.397592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0a1d6e-a57b-4e65-ab9d-026d6afd0182 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.406788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:30.455918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.456579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.456855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.457123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] PATH_INFO: `/v3/projects/4234819ec6fc47859f0b4b22f5cdb344` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.458260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4234819ec6fc47859f0b4b22f5cdb344)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.460145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.504253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4234819ec6fc47859f0b4b22f5cdb344', 'request_id': 'req-981f632f-cd1a-48ee-a65c-b76bbeb8c891'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.511397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4234819ec6fc47859f0b4b22f5cdb344', 'request_id': 'req-981f632f-cd1a-48ee-a65c-b76bbeb8c891'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.517626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4234819ec6fc47859f0b4b22f5cdb344', 'request_id': 'req-981f632f-cd1a-48ee-a65c-b76bbeb8c891'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.528215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] The token cache is being invalidate because project 4234819ec6fc47859f0b4b22f5cdb344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:30.528505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.529130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-981f632f-cd1a-48ee-a65c-b76bbeb8c891 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:30.530631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1247/2473] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:30 2022] DELETE /identity/v3/projects/4234819ec6fc47859f0b4b22f5cdb344 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:30.536099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.536388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.536669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.557428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:30.558643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:30.616320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1227/2474] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:30.624129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.624420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.624700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.644691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:30.645924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:30.653807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1248/2475] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:30.658682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.668334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d669cdc1-bb59-4138-b337-551aca38beb5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.673010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.673646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.673927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.674201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.674844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:15:30.675148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.676733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.687891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1228/2476] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:15:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:15:30.691975 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.701022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a7a8a7-7a14-4277-8335-bd3a540a6349 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.706379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.706972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.707247 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.707515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.708661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.710033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.738480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1249/2477] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:30.742691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.753647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b185abc1-571e-4809-be8b-158ba3d394d2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.811714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.812519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.812866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.813777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.814360 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.816356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.839498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1229/2478] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:30.844017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.855428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c786d91-b07c-4baf-b915-f8af1af33c9c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.862072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.865493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.865830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.866118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.866882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.868487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.881232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1250/2479] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:30.886441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.897251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493e7bd6-5d4a-4653-9390-e2f5f13956d5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.901980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.902665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.903084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.903400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.904243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.906104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e091a283-1215-406e-b5f6-f0d15b430c0a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.919408 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1230/2480] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:30.923685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:30.933962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577b86aa-a842-4491-b9eb-3ea076c016bf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:30.941135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:30.941883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.942160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.942426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] PATH_INFO: `/v3/projects/9ea0f135d58645af8c8e4098a54ea77a/users/37e98b01bc9949c08a6bc9c9e49bd6f1/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:30.959382 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ea0f135d58645af8c8e4098a54ea77a, user_id=37e98b01bc9949c08a6bc9c9e49bd6f1, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:30.962373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:30.977289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1251/2481] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:30 2022] PUT /identity/v3/projects/9ea0f135d58645af8c8e4098a54ea77a/users/37e98b01bc9949c08a6bc9c9e49bd6f1/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:30.988153 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:30.988445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:30.988720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:31.027640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] MFA Rules not processed for user `37e98b01bc9949c08a6bc9c9e49bd6f1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:31.029029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:31.088792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.100046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1231/2482] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:31.111643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:31.113439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:31.164526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:31.179961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37261982-a06a-4851-860c-4ca06e47dc4a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:31.184148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:31.184752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:31.185032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:31.185345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:31.194608 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:31.196060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed5b9ce-4b07-4284-80ea-5788fb3b52d1 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:31.205566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1252/2483] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:15:33.954537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:33.956298 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:34.050919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6fb9-cf06-48b4-b508-10bda1dab839 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:34.056755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:34.057470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:34.057758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:34.058071 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:34.060020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:34.072837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:34.074460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:34.087454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1232/2484] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:33 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:34.551957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217e1-9acc-4602-9d53-b62d75b31bd7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:34.552457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217e1-9acc-4602-9d53-b62d75b31bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:34.552563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78217e1-9acc-4602-9d53-b62d75b31bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:34.574223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b78217e1-9acc-4602-9d53-b62d75b31bd7 None None] MFA Rules not processed for user `80f428660fa3422ca82645b53c7ea2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:34.577076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b78217e1-9acc-4602-9d53-b62d75b31bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:34.706104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1253/2485] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:35.014403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:35.015794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.071281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2dad4e-6d8d-4967-9c2b-0b67c7972691 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:35.074879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:35.075495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:35.075769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:35.076038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:35.077761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.087266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:35.088726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:35.096663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1233/2486] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:35.483436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:35.483721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:35.483996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:35.511683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] MFA Rules not processed for user `a46db75abedb406987ba37de1bf81424`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:35.512906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.588484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1254/2487] 10.222.0.43 () {58 vars in 967 bytes} [Thu Sep 1 05:15:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:35.602740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:35.604163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:35.710039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e513ec7e-a38e-486b-9e28-b8c6d481b546 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:35.720605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba26775b8b3c49ae878e8ca696c3cda5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:35.721715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:35.722272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:35.722815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:35.732675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:35.734297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:35.743664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1234/2488] 10.222.0.43 () {60 vars in 1384 bytes} [Thu Sep 1 05:15:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 01 05:15:38.351118 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:38.367756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ab4d58-8e1e-49bc-a72f-36663b4d8b89 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:38.374307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:38.375797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:38.376167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:38.376703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:38.378758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:38.393762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:38.395509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf4df8a8-a774-4b45-b2e2-ceb898342c21 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:38.407759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1255/2489] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:39.900084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:39.914397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:39.965361 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb785973-e985-4696-954a-f331d3b071dc service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:39.970512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:39.971142 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:39.971419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:39.971693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] PATH_INFO: `/v3/users/37e98b01bc9949c08a6bc9c9e49bd6f1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:39.972800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37e98b01bc9949c08a6bc9c9e49bd6f1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:39.974759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.019714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37e98b01bc9949c08a6bc9c9e49bd6f1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.027568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37e98b01bc9949c08a6bc9c9e49bd6f1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.039723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37e98b01bc9949c08a6bc9c9e49bd6f1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.040423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37e98b01bc9949c08a6bc9c9e49bd6f1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.048868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37e98b01bc9949c08a6bc9c9e49bd6f1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.055019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1235/2490] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:39 2022] DELETE /identity/v3/users/37e98b01bc9949c08a6bc9c9e49bd6f1 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:40.059582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.060047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.060144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.079170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:40.080360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.138284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1256/2491] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:40.148694 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.150148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.207686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac18eca-3b27-4127-8294-b2304756b7e7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.211364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.212257 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.212535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.212817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.223004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.224428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2d10a8-c197-4d4c-a848-cc07c2f54bf3 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.233875 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1236/2492] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:40.505446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.507115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.521519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e65fac0-3d5c-47be-af67-3823120fe95d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.526384 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.527521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.527997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.528281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] PATH_INFO: `/v3/projects/9ea0f135d58645af8c8e4098a54ea77a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.529471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ea0f135d58645af8c8e4098a54ea77a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.531442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.547991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:40.578719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ea0f135d58645af8c8e4098a54ea77a', 'request_id': 'req-6f99b204-94f6-4ec0-a40c-c09d4dc89019'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.587040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ea0f135d58645af8c8e4098a54ea77a', 'request_id': 'req-6f99b204-94f6-4ec0-a40c-c09d4dc89019'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.592472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ea0f135d58645af8c8e4098a54ea77a', 'request_id': 'req-6f99b204-94f6-4ec0-a40c-c09d4dc89019'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.604904 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] The token cache is being invalidate because project 9ea0f135d58645af8c8e4098a54ea77a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:40.605208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.605840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6f99b204-94f6-4ec0-a40c-c09d4dc89019 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:40.607302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1257/2493] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:40 2022] DELETE /identity/v3/projects/9ea0f135d58645af8c8e4098a54ea77a => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:40.612144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.612425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.612695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.632232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:40.633445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.663970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:40.695064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1237/2494] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:40.702914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.703932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.704302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.723937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:40.725137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:40.732996 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1258/2495] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:40.736974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.746625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4287c5d8-3954-4f5a-b84a-709e43250993 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.751921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.752516 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.752800 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.753075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.753757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:15:40.754062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.755714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.767649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1238/2496] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:15:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:15:40.771779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.780728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d6b840-defb-42ee-8233-7bfdad365925 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.785505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.786090 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.786364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.786632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.787256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.789130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.815654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1259/2497] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/projects => generated 405 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:15:40.819824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.830488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4946122-5b2d-4e53-b6b6-92dd30d01829 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.886328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.887024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.887294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.887564 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.888211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.890328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.912868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1239/2498] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:40 2022] POST /identity/v3/users => generated 303 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:40.916833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.927533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446c0b19-f3c1-4593-b11e-a0a5db774a8e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.931985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.932587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.932893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.933170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.933833 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.935480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.945585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1260/2499] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:40.949929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.959958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10aa7be-a8c6-455f-a8ed-c479ff9f5f16 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.964858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.965500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.965776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.966047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:40.966683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:40.968285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9672b9b6-63d4-4a6a-9141-447005555895 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:40.979170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1240/2500] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:40.983290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:40.993556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e44eae-1f1c-432c-a3f0-5bf2b51a555e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:40.998103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:40.998740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:40.999018 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:40.999290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] PATH_INFO: `/v3/projects/e17a8323ac174337bc001e738dbf122a/users/3e075879490346a2a2349afd30a8e44c/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.013475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=e17a8323ac174337bc001e738dbf122a, user_id=3e075879490346a2a2349afd30a8e44c, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.016298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.030328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1261/2501] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:40 2022] PUT /identity/v3/projects/e17a8323ac174337bc001e738dbf122a/users/3e075879490346a2a2349afd30a8e44c/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:15:41.041442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.041728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.042001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.071280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] MFA Rules not processed for user `3e075879490346a2a2349afd30a8e44c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:41.072526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:41.136183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1241/2502] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:41.141472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.201761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c3b384-e346-4f40-bcf7-84059c2e21eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.207149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.207749 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.208031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.208310 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.208938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.210888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.238000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1262/2503] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:41 2022] POST /identity/v3/projects => generated 401 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:41.242109 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.253402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e5774c-abdb-435b-b206-1c4a756c15f0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.281176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:41.310498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.311102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.311378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.311642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.312263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.315001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.338559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1242/2504] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:41 2022] POST /identity/v3/users => generated 307 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:41.342693 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.353323 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfe2424-91ed-4d21-872b-95ea28ea6b0f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.358060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.358659 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.358936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.359205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.359851 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.362110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.372920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1263/2505] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:41.377799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.388554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e6f7b8-3674-472b-93ea-6676fba1cf7c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.393392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.394065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.394348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.394622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] PATH_INFO: `/v3/projects/c5499479af27453dbc93de6e0d7b4c36/users/4ec0b46f566d4e68a1755d6b40ac38b4/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.410314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5499479af27453dbc93de6e0d7b4c36, user_id=4ec0b46f566d4e68a1755d6b40ac38b4, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.412992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.427755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1243/2506] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:41 2022] PUT /identity/v3/projects/c5499479af27453dbc93de6e0d7b4c36/users/4ec0b46f566d4e68a1755d6b40ac38b4/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:41.431810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.441868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff75d90-c129-47f3-92ef-da341cdc0a69 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.450959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:41.501308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.501909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.502182 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.502449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.503107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.504669 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6cc6e2-3573-45c5-84da-35153bafb677 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.514027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1264/2507] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:41 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:41.518141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.528448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15842ef-f92d-4b7a-8a54-2259be244c81 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.533616 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.534262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.534535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.534810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] PATH_INFO: `/v3/projects/c5499479af27453dbc93de6e0d7b4c36/users/4ec0b46f566d4e68a1755d6b40ac38b4/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.536681 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5499479af27453dbc93de6e0d7b4c36, user_id=4ec0b46f566d4e68a1755d6b40ac38b4, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.539341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.549851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1244/2508] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:41 2022] PUT /identity/v3/projects/c5499479af27453dbc93de6e0d7b4c36/users/4ec0b46f566d4e68a1755d6b40ac38b4/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:41.561210 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.561490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.561765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.589403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] MFA Rules not processed for user `4ec0b46f566d4e68a1755d6b40ac38b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:41.590593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:41.655738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1265/2509] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:41 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:41.667504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.669209 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:41.725174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d989a84b-836a-4722-8b19-91c311476d67 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.728733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.729353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.729630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.729897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.739237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.740639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd83102-af9a-4187-94c5-81005e403b81 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:41.749743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1245/2510] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:41 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:41.880925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:41.948058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d88ac17-2b50-4543-9cb5-fb1956fc1442 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:41.952822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:41.953500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:41.953815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:41.954624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] PATH_INFO: `/v3/users/3e075879490346a2a2349afd30a8e44c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:41.956099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e075879490346a2a2349afd30a8e44c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:41.958057 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:42.001042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:42.013200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e075879490346a2a2349afd30a8e44c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.020731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e075879490346a2a2349afd30a8e44c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.027677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e075879490346a2a2349afd30a8e44c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.028345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e075879490346a2a2349afd30a8e44c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.041479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e075879490346a2a2349afd30a8e44c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.047486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1266/2511] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:41 2022] DELETE /identity/v3/users/3e075879490346a2a2349afd30a8e44c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:42.052252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:42.052738 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:42.052824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:42.073798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:42.074977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:42.133404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1246/2512] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:42.143730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:42.145211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:42.200296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9045424a-3598-4a10-b5b4-cfa825eead2a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:42.203812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:42.205028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:42.205343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:42.205614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:42.214977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:42.216252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:42.225952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1267/2513] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:42.498452 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:42.500064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:42.513035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13533fcb-1ca0-419b-9694-6f1f7e5b6945 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:42.518302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:42.519069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:42.519412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:42.519901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] PATH_INFO: `/v3/projects/e17a8323ac174337bc001e738dbf122a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:42.521115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e17a8323ac174337bc001e738dbf122a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:42.523189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:42.548487 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:42.574476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e17a8323ac174337bc001e738dbf122a', 'request_id': 'req-c00f7124-ac33-4476-888e-cf1aae826a25'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.581347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e17a8323ac174337bc001e738dbf122a', 'request_id': 'req-c00f7124-ac33-4476-888e-cf1aae826a25'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.587397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e17a8323ac174337bc001e738dbf122a', 'request_id': 'req-c00f7124-ac33-4476-888e-cf1aae826a25'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.600281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] The token cache is being invalidate because project e17a8323ac174337bc001e738dbf122a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:42.600586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.601250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.602750 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1247/2514] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:42 2022] DELETE /identity/v3/projects/e17a8323ac174337bc001e738dbf122a => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:42.606760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:42.616952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f03d38-92dc-415d-b159-fc3b8c00d22b service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:42.673887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:42.674544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:42.674820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:42.675199 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] PATH_INFO: `/v3/users/4ec0b46f566d4e68a1755d6b40ac38b4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:42.676342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ec0b46f566d4e68a1755d6b40ac38b4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:42.678302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:42.725072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ec0b46f566d4e68a1755d6b40ac38b4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.731727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ec0b46f566d4e68a1755d6b40ac38b4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.734279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:42.739507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ec0b46f566d4e68a1755d6b40ac38b4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.740235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ec0b46f566d4e68a1755d6b40ac38b4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.752687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-def3f1c9-b456-459d-91d7-bdbdbe65cd80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ec0b46f566d4e68a1755d6b40ac38b4'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:42.758512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1268/2515] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:42 2022] DELETE /identity/v3/users/4ec0b46f566d4e68a1755d6b40ac38b4 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:43.032347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.033948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:43.047357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f7124-ac33-4476-888e-cf1aae826a25 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.105208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.105905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.106103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.106381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] PATH_INFO: `/v3/projects/c5499479af27453dbc93de6e0d7b4c36` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.107489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5499479af27453dbc93de6e0d7b4c36)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.109443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.154136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5499479af27453dbc93de6e0d7b4c36', 'request_id': 'req-ff4033a7-497b-489b-b897-7dccab8f5478'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:43.160288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5499479af27453dbc93de6e0d7b4c36', 'request_id': 'req-ff4033a7-497b-489b-b897-7dccab8f5478'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:43.165785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5499479af27453dbc93de6e0d7b4c36', 'request_id': 'req-ff4033a7-497b-489b-b897-7dccab8f5478'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:43.177832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] The token cache is being invalidate because project c5499479af27453dbc93de6e0d7b4c36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:43.178134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:43.178723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ff4033a7-497b-489b-b897-7dccab8f5478 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:43.180218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1248/2516] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:43 2022] DELETE /identity/v3/projects/c5499479af27453dbc93de6e0d7b4c36 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:43.185241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.185688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.185805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.206567 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:43.207771 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:43.264688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1269/2517] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:43.273065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.273394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.273668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.292898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:43.294047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:43.302346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1249/2518] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:43.306583 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.316944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeb9d90-1a8d-46c8-b736-22d76ad64daf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.321586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.322184 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.322466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.322743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.323392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:15:43.323694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.325306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.338188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1270/2519] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:15:43.342977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.352176 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3059c8ce-376d-47c3-9685-d497bd27a8db None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.356760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.357378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.357659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.357935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.358556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.361152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.388938 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1250/2520] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:43.393229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.403354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ae7cf8-a01f-4fc9-9a3f-5571a78d6718 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.458231 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.458852 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.459128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.459399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.460010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.462223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.484123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1271/2521] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:15:43.487241 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.497198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebc9446-65cf-4242-9bd7-5d1df4fb61c2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.502603 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.503203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.503479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.503746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.504379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.505990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.511362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:43.517387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1251/2522] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:43.521087 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.531421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b55565-005e-4409-a153-1b3e0afa7ed5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.536265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.536860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.537174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.537479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.538117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.539710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e685bf62-aaae-4cfd-8d6c-44dc67031061 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.550723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1272/2523] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:43.554700 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.565265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a2b70c-fc28-44e7-a4cf-42a78f468fd2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.570029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.570752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.571066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.571347 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] PATH_INFO: `/v3/projects/48c937a94b7a48bea8ef6f0c7960da3f/users/ddbb23ef3c244d23801401d823a4c7d6/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.586125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=48c937a94b7a48bea8ef6f0c7960da3f, user_id=ddbb23ef3c244d23801401d823a4c7d6, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.589060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.601654 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1252/2524] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:43 2022] PUT /identity/v3/projects/48c937a94b7a48bea8ef6f0c7960da3f/users/ddbb23ef3c244d23801401d823a4c7d6/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:43.612366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.612650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.612926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.642611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] MFA Rules not processed for user `ddbb23ef3c244d23801401d823a4c7d6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:43.643817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:43.676582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:43.712478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1273/2525] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:43.716993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.785263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c26a7fc-8afb-4dff-b5db-910797f481d4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.790130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.790740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.791018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.791291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.791914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.793883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.823631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1253/2526] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/projects => generated 381 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:43.825786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.837248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242666-fbb6-4cc8-b14c-f18fad526006 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.896347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.896939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.897252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.897527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.898170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.900078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.925212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1274/2527] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:43 2022] POST /identity/v3/users => generated 297 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:43.927527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.941299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362388a9-3a41-4f0d-8777-7ba103facc87 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.946396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.946982 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.947311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.947587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.948238 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:43.950473 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:43.961453 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1254/2528] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:43 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:43.965916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:43.977176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3b4b31-3565-4774-92bd-67e150e6483c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:43.982001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:43.982665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:43.982945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:43.983222 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] PATH_INFO: `/v3/projects/af0e445f0f0e41d686459159c1fe2402/users/74b8ebd81df0453e8a06f8641ba4d3eb/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:43.999825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0e445f0f0e41d686459159c1fe2402, user_id=74b8ebd81df0453e8a06f8641ba4d3eb, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:44.003179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:44.020719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1275/2529] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:43 2022] PUT /identity/v3/projects/af0e445f0f0e41d686459159c1fe2402/users/74b8ebd81df0453e8a06f8641ba4d3eb/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:44.024776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:44.036961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ebaaec-43fb-40ef-90c4-8774ad258a0b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:44.111400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:44.112046 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.112304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.112577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.113400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:44.115015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d21ec2e-0fce-4a31-9512-126908e1b9cc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:44.128815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1255/2530] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:15:44.130372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:44.141027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1e672d-fd7e-439e-b6d7-5d91e02a49cc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:44.146577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:44.147256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.147540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.147839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] PATH_INFO: `/v3/projects/af0e445f0f0e41d686459159c1fe2402/users/74b8ebd81df0453e8a06f8641ba4d3eb/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.149871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af0e445f0f0e41d686459159c1fe2402, user_id=74b8ebd81df0453e8a06f8641ba4d3eb, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:44.152633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:44.164626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1276/2531] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:44 2022] PUT /identity/v3/projects/af0e445f0f0e41d686459159c1fe2402/users/74b8ebd81df0453e8a06f8641ba4d3eb/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:15:44.175934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.176224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.176532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.207001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] MFA Rules not processed for user `74b8ebd81df0453e8a06f8641ba4d3eb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:44.208020 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:44.245850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:44.287773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1256/2532] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:44 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:44.299078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:44.300774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:44.358003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c477c96d-453b-4594-8857-95f9d83ce144 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:44.361740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:44.362335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.362612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.362882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.371647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:44.373055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:44.382933 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1277/2533] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:44 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:44.459521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:44.469592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c6f1d2-31e1-4aa4-8963-6ff0a2d2b659 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:44.473155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:44.473770 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:44.474047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:44.474319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:44.530380 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:44.531797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d8ddfc-1ed6-4763-9ea1-5129163e3cd6 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:44.541395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1257/2534] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:44 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:51.473396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:51.502188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:51.536128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb73d8c4-14cd-4514-99ab-55c289da57f4 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:51.540558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:51.541197 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:51.541486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:51.541759 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] PATH_INFO: `/v3/users/ddbb23ef3c244d23801401d823a4c7d6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:51.542863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddbb23ef3c244d23801401d823a4c7d6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:51.544819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:51.589773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddbb23ef3c244d23801401d823a4c7d6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:51.596543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddbb23ef3c244d23801401d823a4c7d6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:51.604217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddbb23ef3c244d23801401d823a4c7d6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:51.604838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddbb23ef3c244d23801401d823a4c7d6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:51.616671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddbb23ef3c244d23801401d823a4c7d6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:51.622429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1278/2535] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:51 2022] DELETE /identity/v3/users/ddbb23ef3c244d23801401d823a4c7d6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:51.626906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:51.627370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:51.627498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:51.646571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:51.647747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:51.704193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1258/2536] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:51.714725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:51.716137 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:51.772349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a45d0-4783-45af-8919-6cbe977e0041 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:51.775916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:51.776514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:51.776793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:51.777064 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:51.786858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:51.788278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:51.797445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1279/2537] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:52.066045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.067435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:52.079585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a79f60-e2f9-4477-934b-63c9b75c5676 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:52.084265 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:52.084894 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.085172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.085492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] PATH_INFO: `/v3/projects/48c937a94b7a48bea8ef6f0c7960da3f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.086891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] RBAC: Authorizing `identity:delete_project(project_id=48c937a94b7a48bea8ef6f0c7960da3f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:52.088788 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:52.136519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48c937a94b7a48bea8ef6f0c7960da3f', 'request_id': 'req-4b9b491f-522b-49a4-bbb7-a5ce068bc326'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.143403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48c937a94b7a48bea8ef6f0c7960da3f', 'request_id': 'req-4b9b491f-522b-49a4-bbb7-a5ce068bc326'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.149428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48c937a94b7a48bea8ef6f0c7960da3f', 'request_id': 'req-4b9b491f-522b-49a4-bbb7-a5ce068bc326'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.151910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:52.164437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] The token cache is being invalidate because project 48c937a94b7a48bea8ef6f0c7960da3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:52.165131 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.165775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.168054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1259/2538] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:52 2022] DELETE /identity/v3/projects/48c937a94b7a48bea8ef6f0c7960da3f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:52.173156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.183615 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e70a658-93e3-4dc0-b74f-57227332068a service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:52.227721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:52.240899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:52.241532 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.241813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.242085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] PATH_INFO: `/v3/users/74b8ebd81df0453e8a06f8641ba4d3eb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.243188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b8ebd81df0453e8a06f8641ba4d3eb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:52.245158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:52.291497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b8ebd81df0453e8a06f8641ba4d3eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.298370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b8ebd81df0453e8a06f8641ba4d3eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.305624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b8ebd81df0453e8a06f8641ba4d3eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.306246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b8ebd81df0453e8a06f8641ba4d3eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.318815 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8573eb5c-4de5-49b6-92ea-a8ad471ece97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b8ebd81df0453e8a06f8641ba4d3eb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.324593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1280/2539] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:15:52 2022] DELETE /identity/v3/users/74b8ebd81df0453e8a06f8641ba4d3eb => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:52.598647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.600099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:52.613143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9b491f-522b-49a4-bbb7-a5ce068bc326 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:52.669522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:52.670183 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.670463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.670736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] PATH_INFO: `/v3/projects/af0e445f0f0e41d686459159c1fe2402` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.671901 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af0e445f0f0e41d686459159c1fe2402)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:52.673838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:52.721356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af0e445f0f0e41d686459159c1fe2402', 'request_id': 'req-a4a448f0-f2ed-456c-b04c-27e53bf6b288'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.727514 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af0e445f0f0e41d686459159c1fe2402', 'request_id': 'req-a4a448f0-f2ed-456c-b04c-27e53bf6b288'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.733016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af0e445f0f0e41d686459159c1fe2402', 'request_id': 'req-a4a448f0-f2ed-456c-b04c-27e53bf6b288'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.744925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] The token cache is being invalidate because project af0e445f0f0e41d686459159c1fe2402 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:15:52.745274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.746253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a4a448f0-f2ed-456c-b04c-27e53bf6b288 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:15:52.747747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1260/2540] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:15:52 2022] DELETE /identity/v3/projects/af0e445f0f0e41d686459159c1fe2402 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:52.754133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.754604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.754704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.774522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:52.775712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:52.834689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1281/2541] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:52.842677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.842956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.843255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.862879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:52.864070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:52.871803 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1261/2542] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:15:52.875920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.886043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dcb958-944e-4c16-8b09-5d05bc7f1bd9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:52.890582 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:52.891179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.891457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.891727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.892368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:15:52.892666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:52.895029 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:52.907695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1282/2543] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:15:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:15:52.912218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.921569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f09e4a-fce3-4464-beea-6cd0b89b28a4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:52.926393 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:52.926926 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:52.927240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:52.927523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:52.928146 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:52.930068 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:52.959097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1262/2544] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:52 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:52.963698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:52.973805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf6a7cf-50e6-472c-921e-d05c2a42aebf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.022636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:53.030542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.031337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.031819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.032291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.032958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.035183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.057407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1283/2545] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:52 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:53.061485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.072454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc57b161-f2c9-47c8-8b93-18f2274600e7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.077035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.077668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.077942 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.078211 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.078846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.080435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.091152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1263/2546] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:53.095132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.106698 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80688a5-8cad-4a03-898b-243309150fbd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.111332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.111955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.112791 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.113062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.113752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.115356 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a4dd0-a8a2-418c-b4df-7521c15885e3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.126130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1284/2547] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:53.131248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.141739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64851004-4ddc-4523-b40e-144207ad978b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.146767 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.147426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.147702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.147975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] PATH_INFO: `/v3/projects/b18b9229b31640eea537d48a38be7adb/users/93f825fd97d942be8ee6b167422bf2a6/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.162885 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] RBAC: Authorizing `identity:create_grant(project_id=b18b9229b31640eea537d48a38be7adb, user_id=93f825fd97d942be8ee6b167422bf2a6, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.165584 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.180943 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1264/2548] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:53 2022] PUT /identity/v3/projects/b18b9229b31640eea537d48a38be7adb/users/93f825fd97d942be8ee6b167422bf2a6/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:53.193273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.193565 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.193840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.220873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] MFA Rules not processed for user `93f825fd97d942be8ee6b167422bf2a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:53.222219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:53.285086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1285/2549] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:53.289627 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.314578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:53.357674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6a8558-35de-45ce-8d50-dd8d5b3fe43d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.363088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.363729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.364013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.364286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.364912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.366915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.394663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1265/2550] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:15:53 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:53.398742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.410001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbbac61-951a-42fd-8e8a-d08fc6f4d815 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.465972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.466530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.466805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.467079 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.467706 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.469626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.491159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1286/2551] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:15:53 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:15:53.495184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.505688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd48320-88c7-41fa-a3f8-19036f9dc771 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.510321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.510916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.511196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.511471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.512106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.513791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.524107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1266/2552] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:53.528240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.538723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fc1341-fd81-42f6-b91d-66dde8913833 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.543374 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.544033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.544342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.544642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] PATH_INFO: `/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8/users/73c7519803d6413a8eb6eff258c62d50/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.559961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f2f409e6d742d0a2de23b5680b39c8, user_id=73c7519803d6413a8eb6eff258c62d50, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.562636 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.575281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1287/2553] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:53 2022] PUT /identity/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8/users/73c7519803d6413a8eb6eff258c62d50/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:53.579177 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.589258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41408312-9ee0-46df-8a44-e234f061738c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.644317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.644933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.645203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.646031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.646144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.647670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fb50b1-63fa-4362-881a-8c8d06c4c38a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.657070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1267/2554] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:15:53 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:15:53.661962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.672343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba842fba-6c0c-4f31-90bb-9dbe32b70a98 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.677684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.678329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.678609 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.678881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] PATH_INFO: `/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8/users/73c7519803d6413a8eb6eff258c62d50/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.680772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2f2f409e6d742d0a2de23b5680b39c8, user_id=73c7519803d6413a8eb6eff258c62d50, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.683430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.693711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1288/2555] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:15:53 2022] PUT /identity/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8/users/73c7519803d6413a8eb6eff258c62d50/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:15:53.703551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.704011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.704108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.732757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] MFA Rules not processed for user `73c7519803d6413a8eb6eff258c62d50`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:15:53.733937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:53.800404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1268/2556] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:15:53 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:15:53.811489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:53.813166 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:53.832539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:15:53.871000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506d8c9-ab20-4ff0-8d31-16e9296d43ec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:53.874597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:53.875189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:53.875466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:53.875739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:53.929972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:53.931395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:53.940272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1289/2557] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:15:58.130281 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:15:58.131712 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:15:58.143907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299b3e8-2847-4b1c-aa26-11bb263e3ad6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:15:58.147425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:15:58.148023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:15:58.148306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:15:58.148579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:15:58.157521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:15:58.159463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67882b7b-377e-4cb8-a57f-08c9d327c221 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:15:58.168805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1269/2558] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:15:58 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:03.051938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:03.115656 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b777af-5334-43cb-bfda-548245fea194 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:03.120226 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:03.120850 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.121133 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.121447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] PATH_INFO: `/v3/users/93f825fd97d942be8ee6b167422bf2a6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.122571 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93f825fd97d942be8ee6b167422bf2a6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:03.124509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:03.173088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93f825fd97d942be8ee6b167422bf2a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.181625 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93f825fd97d942be8ee6b167422bf2a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.189059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93f825fd97d942be8ee6b167422bf2a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.189703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93f825fd97d942be8ee6b167422bf2a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.196864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:03.202574 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93f825fd97d942be8ee6b167422bf2a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.209577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1290/2559] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:03 2022] DELETE /identity/v3/users/93f825fd97d942be8ee6b167422bf2a6 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:03.214339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.214832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.214945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.222749 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:03.236358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:03.238184 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:03.294873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1270/2560] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:03.305425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:03.306958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:03.364570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d1a08-4f5f-4c6b-9812-bfe9ee2c3022 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:03.368224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:03.368827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.369107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.369407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.378249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:03.379919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:03.390340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1291/2561] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:03.658263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:03.660714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:03.672503 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40b4df7-1b8c-4974-a9a0-643228535619 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:03.677158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:03.677844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.678117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.678389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] PATH_INFO: `/v3/projects/b18b9229b31640eea537d48a38be7adb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.679510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b18b9229b31640eea537d48a38be7adb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:03.681427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:03.729397 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b18b9229b31640eea537d48a38be7adb', 'request_id': 'req-7e2a717c-2147-436f-8ed6-3e93dd149655'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.735368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b18b9229b31640eea537d48a38be7adb', 'request_id': 'req-7e2a717c-2147-436f-8ed6-3e93dd149655'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.740779 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b18b9229b31640eea537d48a38be7adb', 'request_id': 'req-7e2a717c-2147-436f-8ed6-3e93dd149655'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.753545 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] The token cache is being invalidate because project b18b9229b31640eea537d48a38be7adb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:03.753832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.754442 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.755887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1271/2562] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:03 2022] DELETE /identity/v3/projects/b18b9229b31640eea537d48a38be7adb => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:03.760803 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:03.773632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27603d67-5d7b-43e0-9235-dba586d00e43 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:03.828426 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:03.829048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:03.829354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:03.829626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] PATH_INFO: `/v3/users/73c7519803d6413a8eb6eff258c62d50` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:03.831423 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73c7519803d6413a8eb6eff258c62d50)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:03.833368 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:03.878678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73c7519803d6413a8eb6eff258c62d50'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.885650 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73c7519803d6413a8eb6eff258c62d50'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.893635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73c7519803d6413a8eb6eff258c62d50'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.894280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73c7519803d6413a8eb6eff258c62d50'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.905782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-473a2b98-0fcf-4a2b-9461-a64f5ce35a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73c7519803d6413a8eb6eff258c62d50'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:03.911555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1292/2563] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:03 2022] DELETE /identity/v3/users/73c7519803d6413a8eb6eff258c62d50 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:04.182385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.184641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.200205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e2a717c-2147-436f-8ed6-3e93dd149655 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.260773 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.261504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.261617 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.261876 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] PATH_INFO: `/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.263002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2f2f409e6d742d0a2de23b5680b39c8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.264957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.294530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:04.311346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2f2f409e6d742d0a2de23b5680b39c8', 'request_id': 'req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:04.318370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2f2f409e6d742d0a2de23b5680b39c8', 'request_id': 'req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:04.323864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2f2f409e6d742d0a2de23b5680b39c8', 'request_id': 'req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:04.336168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] The token cache is being invalidate because project a2f2f409e6d742d0a2de23b5680b39c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:04.336460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:04.337087 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f821b0ad-ff7e-47b4-a2bf-6ce7310ae9b4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:04.338587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1272/2564] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:04 2022] DELETE /identity/v3/projects/a2f2f409e6d742d0a2de23b5680b39c8 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:04.344451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.344922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.345034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.364821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:04.366075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.371290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:04.429683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1293/2565] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:04.438349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2097-462a-413e-9cab-d86420738620 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.438638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2097-462a-413e-9cab-d86420738620 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.438916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781d2097-462a-413e-9cab-d86420738620 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.459401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-781d2097-462a-413e-9cab-d86420738620 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:04.460611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-781d2097-462a-413e-9cab-d86420738620 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.468780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1273/2566] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:04.473043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.482510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc4e048-b0e2-420f-bdba-1a75bcc6a8b4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.487570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.488157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.488430 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.488694 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.489359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:04.489753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.491366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.503380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1294/2567] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:16:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:04.507823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2097-462a-413e-9cab-d86420738620 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.516997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781d2097-462a-413e-9cab-d86420738620 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.521727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.522323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.522611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.522889 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.523511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.525416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.552086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1274/2568] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:04.556343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.566835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274a9a58-d82a-43ba-9661-6f97e39c93fa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.622657 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.623262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.623542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.623814 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.624434 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.626363 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.647500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1295/2569] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:04.651316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.664664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84423567-4220-48f5-b28d-f238e30f7dbf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.669329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.669930 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.670212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.670486 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.671133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.672718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.683294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1275/2570] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:04.687219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.697146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235655f3-7cba-4db2-a45f-c769db59b95f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.701751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.702355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.702628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.702902 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.703540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.705112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768128d8-58f7-4a79-beb4-03b1eadcc21c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.718105 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1296/2571] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:04.722715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.732573 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afb1cc-9f48-4832-96ae-69c408dc0330 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.737752 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.738407 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.738688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.738965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] PATH_INFO: `/v3/projects/95072b3fee6c4328b1b79b66ba54c70b/users/f21edfac7d7f431d823b2989a0040c83/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.753337 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=95072b3fee6c4328b1b79b66ba54c70b, user_id=f21edfac7d7f431d823b2989a0040c83, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.756047 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.768675 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1276/2572] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:04 2022] PUT /identity/v3/projects/95072b3fee6c4328b1b79b66ba54c70b/users/f21edfac7d7f431d823b2989a0040c83/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:04.780826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.781114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.781424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.809829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] MFA Rules not processed for user `f21edfac7d7f431d823b2989a0040c83`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:04.811012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:04.875516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1297/2573] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:04.880251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.941511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c76018-b617-40ad-9a67-ddbda517041d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.946301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:04.946918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:04.947202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:04.947478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:04.948112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:04.950060 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:04.981280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1277/2574] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/projects => generated 375 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:04.982455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:04.993458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc77136-417f-4edf-800a-0d476fac2ffb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:04.996978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:05.050581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.051104 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.051380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.051647 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.052274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.054273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.074524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1298/2575] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:04 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:05.078581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.089863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf661abb-1a58-4695-9d6e-df766625af00 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.094449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.095045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.095334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.095605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.096906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.098555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.108832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1278/2576] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:05.112826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.122702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f0b9d-1bc3-4890-ad5e-583327ce098d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.127429 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.128026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.128304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.128575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.129240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.130820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3c63da-2409-41bc-9a40-1dbbc0762bab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.140992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1299/2577] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:05.145704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.155863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8181230b-6e8f-48bf-b66e-94774b862a07 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.161158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.161852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.162134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.162412 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] PATH_INFO: `/v3/projects/ccdc4571472146fb8bd16acbf058c5bf/users/afbd7ffcd1df4725b52571e8ca9354fd/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.178996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ccdc4571472146fb8bd16acbf058c5bf, user_id=afbd7ffcd1df4725b52571e8ca9354fd, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.182043 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.195623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1279/2578] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:05 2022] PUT /identity/v3/projects/ccdc4571472146fb8bd16acbf058c5bf/users/afbd7ffcd1df4725b52571e8ca9354fd/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:05.206907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.207209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.207474 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.236893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] MFA Rules not processed for user `afbd7ffcd1df4725b52571e8ca9354fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:05.238206 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:05.304341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1300/2579] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:05.308793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.313426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:05.372702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4b8470-1cce-447f-8bb8-6d7a9eed5b07 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.377971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.378574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.378855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.379133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.379761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.381697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.408995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1280/2580] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:05 2022] POST /identity/v3/projects => generated 375 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:05.413578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.424375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12527064-8950-401e-aab7-1a3ed0540e87 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.481826 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.482451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.482724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.482991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.483605 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.485835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.507329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1301/2581] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:05 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:05.511273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.522201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4523835-ca89-48c8-b632-bee60614ca65 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.526840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.527438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.527720 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.527994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.528631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.530414 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.541334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1281/2582] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:05.545334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.552299 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:05.556212 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570a438e-e04d-4e31-bdf1-e0665a7a0084 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.561779 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.562496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.562775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.563052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] PATH_INFO: `/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742/users/5571ce8bcec4417f8c94703edd5b003e/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.579380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e89bfe0f9d49edb3f87b63b55db742, user_id=5571ce8bcec4417f8c94703edd5b003e, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.582737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.596966 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1302/2583] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:05 2022] PUT /identity/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742/users/5571ce8bcec4417f8c94703edd5b003e/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:05.601069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.611059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be10e0-5fe0-41b9-8916-406de2309a1d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.666772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.667374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.667656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.667935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.668571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.670189 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c544a01-b5ab-40ac-a59b-cec330e8f920 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.679985 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1282/2584] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:05 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:05.684128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.694799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c43caf9-0bbf-420e-8c6f-ebfe819ca47d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.699519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.700191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.700465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.700731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] PATH_INFO: `/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742/users/5571ce8bcec4417f8c94703edd5b003e/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.702680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9e89bfe0f9d49edb3f87b63b55db742, user_id=5571ce8bcec4417f8c94703edd5b003e, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.706270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.716819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1303/2585] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:05 2022] PUT /identity/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742/users/5571ce8bcec4417f8c94703edd5b003e/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:05.727092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.727376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.727707 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.760198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] MFA Rules not processed for user `5571ce8bcec4417f8c94703edd5b003e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:05.761449 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:05.824302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:05.830431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1283/2586] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:05 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:05.842103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:05.843827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:05.901380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366dd93-42e6-401a-9b1a-c2eea1335bd0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:05.904985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:05.905606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:05.905886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:05.906156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:05.962912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:05.964344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:05.973351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1304/2587] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:07.485348 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:07.487316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:07.498977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc732f3-cb79-4683-960c-3fec4e8434c3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:07.503305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:07.503924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:07.504201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:07.504471 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:07.558816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:07.560226 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:07.569631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1284/2588] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:08.084268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:08.093068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092d7c45-4665-4446-b088-94c20a574562 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:08.097403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:08.097997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:08.098273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:08.098541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:08.107390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:08.108813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033e1f83-636e-4f53-87e3-b37688360c95 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:08.118068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1305/2589] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:08 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:11.983736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:12.046135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917cbc92-ab3d-4f16-9e7c-d190841b1f24 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:12.051472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:12.052196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:12.052476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:12.052878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] PATH_INFO: `/v3/users/f21edfac7d7f431d823b2989a0040c83` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:12.053953 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f21edfac7d7f431d823b2989a0040c83)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:12.055884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:12.105589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f21edfac7d7f431d823b2989a0040c83'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.113099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f21edfac7d7f431d823b2989a0040c83'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.124785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f21edfac7d7f431d823b2989a0040c83'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.125518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f21edfac7d7f431d823b2989a0040c83'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.135559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f21edfac7d7f431d823b2989a0040c83'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.142119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1285/2590] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:11 2022] DELETE /identity/v3/users/f21edfac7d7f431d823b2989a0040c83 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:12.147495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:12.148000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:12.148108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:12.167761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:12.168969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:12.228874 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1306/2591] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:12.238668 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:12.240102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:12.259285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:12.299391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80308b-3805-48d2-837a-f20f1efaa8a0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:12.303123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:12.303731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:12.304008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:12.304280 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:12.314351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:12.316399 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:12.326858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1286/2592] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:12.606805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:12.609213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:12.642476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5fa2c6-c058-4094-bbe4-c29ecb9f8e3a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:12.647581 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:12.648344 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:12.648796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:12.649046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] PATH_INFO: `/v3/projects/95072b3fee6c4328b1b79b66ba54c70b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:12.650268 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95072b3fee6c4328b1b79b66ba54c70b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:12.652250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:12.655287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:12.708674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95072b3fee6c4328b1b79b66ba54c70b', 'request_id': 'req-45c701d7-afd5-478f-b09d-157d478df251'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.717234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95072b3fee6c4328b1b79b66ba54c70b', 'request_id': 'req-45c701d7-afd5-478f-b09d-157d478df251'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.724526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95072b3fee6c4328b1b79b66ba54c70b', 'request_id': 'req-45c701d7-afd5-478f-b09d-157d478df251'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.738058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] The token cache is being invalidate because project 95072b3fee6c4328b1b79b66ba54c70b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:12.738355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.739045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.744082 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1307/2593] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:12 2022] DELETE /identity/v3/projects/95072b3fee6c4328b1b79b66ba54c70b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:12.745574 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:12.757861 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528fb065-c026-4a29-b7f9-7ffd84f22fb8 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:12.827929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:12.829023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:12.829510 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:12.830032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] PATH_INFO: `/v3/users/afbd7ffcd1df4725b52571e8ca9354fd` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:12.831893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=afbd7ffcd1df4725b52571e8ca9354fd)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:12.835362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:12.918523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'afbd7ffcd1df4725b52571e8ca9354fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.928398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'afbd7ffcd1df4725b52571e8ca9354fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.957460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'afbd7ffcd1df4725b52571e8ca9354fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.958498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'afbd7ffcd1df4725b52571e8ca9354fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.969906 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'afbd7ffcd1df4725b52571e8ca9354fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:12.979642 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1287/2594] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:12 2022] DELETE /identity/v3/users/afbd7ffcd1df4725b52571e8ca9354fd => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:13.314279 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:13.316065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:13.330566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c701d7-afd5-478f-b09d-157d478df251 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:13.398606 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:13.400201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:13.400578 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:13.401140 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] PATH_INFO: `/v3/projects/ccdc4571472146fb8bd16acbf058c5bf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:13.402667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ccdc4571472146fb8bd16acbf058c5bf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:13.404796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:13.461664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ccdc4571472146fb8bd16acbf058c5bf', 'request_id': 'req-d872e5e6-2d88-45ed-b9d3-8a06194e3401'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.470546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ccdc4571472146fb8bd16acbf058c5bf', 'request_id': 'req-d872e5e6-2d88-45ed-b9d3-8a06194e3401'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.477684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ccdc4571472146fb8bd16acbf058c5bf', 'request_id': 'req-d872e5e6-2d88-45ed-b9d3-8a06194e3401'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.492061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] The token cache is being invalidate because project ccdc4571472146fb8bd16acbf058c5bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:13.492519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.493276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.495136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1308/2595] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:13 2022] DELETE /identity/v3/projects/ccdc4571472146fb8bd16acbf058c5bf => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:13.499077 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:13.500790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:13.517316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4c92c9-9423-40d0-a589-f5f5831a9cf4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:13.557718 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:13.587008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:13.587560 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:13.588091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:13.588377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] PATH_INFO: `/v3/users/5571ce8bcec4417f8c94703edd5b003e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:13.589610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5571ce8bcec4417f8c94703edd5b003e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:13.591843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:13.640509 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5571ce8bcec4417f8c94703edd5b003e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.648677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5571ce8bcec4417f8c94703edd5b003e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.661717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5571ce8bcec4417f8c94703edd5b003e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.662466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5571ce8bcec4417f8c94703edd5b003e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.671167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e42d955-794f-4558-96a1-f436a43ef24c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5571ce8bcec4417f8c94703edd5b003e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:13.678964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1288/2596] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:13 2022] DELETE /identity/v3/users/5571ce8bcec4417f8c94703edd5b003e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:13.959283 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:13.961059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:13.975049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d872e5e6-2d88-45ed-b9d3-8a06194e3401 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:13.994993 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:14.035267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.035855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.036129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.036398 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] PATH_INFO: `/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.037540 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9e89bfe0f9d49edb3f87b63b55db742)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.039449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.084237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9e89bfe0f9d49edb3f87b63b55db742', 'request_id': 'req-a7184bfa-bd96-4274-a61b-f68b211565ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:14.091644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9e89bfe0f9d49edb3f87b63b55db742', 'request_id': 'req-a7184bfa-bd96-4274-a61b-f68b211565ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:14.097782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9e89bfe0f9d49edb3f87b63b55db742', 'request_id': 'req-a7184bfa-bd96-4274-a61b-f68b211565ca'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:14.108871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] The token cache is being invalidate because project f9e89bfe0f9d49edb3f87b63b55db742 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:14.109157 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:14.109895 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7184bfa-bd96-4274-a61b-f68b211565ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:14.111375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1309/2597] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:13 2022] DELETE /identity/v3/projects/f9e89bfe0f9d49edb3f87b63b55db742 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:14.116136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.116418 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.116691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.136351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:14.137673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:14.208813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1289/2598] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:14.210700 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.211005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.211264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.232213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:14.233428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:14.241767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1310/2599] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:14.250977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.266030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e2a1f9-2bd1-490f-b2ea-51f2376c2f39 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.271168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.271776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.272059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.272330 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.272978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:14.273316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.274935 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.287968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1290/2600] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:14.292441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.302238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e320f37d-dda5-4601-a56d-d1f34fdcda4c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.307154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.307932 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.308213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.308503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.309136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.311050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.338997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1311/2601] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:14 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:14.343538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.356629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caed48-8cde-409e-a886-36d94a69a603 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.415181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:14.433260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.433868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.434157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.434416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.435039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.436944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.461264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1291/2602] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:14 2022] POST /identity/v3/users => generated 287 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:14.465306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.475939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b432d-1cdf-4f50-ab43-e3cf9c4a85af admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.480660 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.481287 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.481575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.481848 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.482497 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.484138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.497538 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1312/2603] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:14.498754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.509756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e952efc8-d79a-4580-8d8f-06d55b714fd4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.514463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.515070 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.515350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.515624 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.516262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.518640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42503ff-a479-4672-b730-64925e69d66a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.533780 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1292/2604] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:14.534910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.545509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7b720-f79f-4ac6-8644-46e4c0332068 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.550466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.551121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.551403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.551677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] PATH_INFO: `/v3/projects/d30c6fdba16c4a31b4ee21e7aa0ffe2e/users/35cccd9b5e50416aa045f8882dc75807/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.567369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d30c6fdba16c4a31b4ee21e7aa0ffe2e, user_id=35cccd9b5e50416aa045f8882dc75807, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.570154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.584587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1313/2605] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:14 2022] PUT /identity/v3/projects/d30c6fdba16c4a31b4ee21e7aa0ffe2e/users/35cccd9b5e50416aa045f8882dc75807/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:14.595143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.595425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.595834 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.623021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] MFA Rules not processed for user `35cccd9b5e50416aa045f8882dc75807`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:14.624244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:14.689316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1293/2606] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:14.700014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:14.701839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:14.759997 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:14.763912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8416df8e-bbfc-455b-92eb-c8a6dad538e8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:14.770278 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:14.771436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:14.771562 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:14.771782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:14.780990 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:14.782477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820ea85e-c5c1-48f0-aeb6-f9becbff9585 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:14.791989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1314/2607] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:17.248882 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:17.250547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:17.310302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118b25b1-df15-4d0c-8923-b793973cf7fe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:17.313817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:17.315017 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:17.315290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:17.315554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:17.317273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:17.379227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:17.380669 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393e9e8-264e-44f9-ae31-087472634022 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:17.390384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1294/2608] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:20.639128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:20.639590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:20.639704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:20.641040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1315/2609] 10.222.0.43 () {54 vars in 961 bytes} [Thu Sep 1 05:16:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:16:20.647595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:20.648413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:20.648702 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:20.656310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:20.678269 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] MFA Rules not processed for user `fdc935f85996421c8758edab8f2b7202`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:20.679589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:20.694471 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:20.696688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:20.732716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c08fa5-ed27-4aaf-8c7f-2f5d6f3f86f3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:20.741506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:20.742084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:20.742364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:20.742633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] PATH_INFO: `/v3/users/386e1605489846248e898a62c79643fe` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:20.743983 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=386e1605489846248e898a62c79643fe)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:20.745922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:20.762353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1295/2610] 10.222.0.43 () {58 vars in 1058 bytes} [Thu Sep 1 05:16:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:20.770155 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:20.781575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec0c712-50e4-4c2f-a867-611d2af34399 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:20.787599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:20.788308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:20.788634 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:20.788934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:20.790990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:20.804468 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:20.806402 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:20.810301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '386e1605489846248e898a62c79643fe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:20.833517 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '386e1605489846248e898a62c79643fe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:20.833632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1296/2611] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:20 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:20.845047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '386e1605489846248e898a62c79643fe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:20.845584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '386e1605489846248e898a62c79643fe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:20.859378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-92a5aa1c-dd29-4c6d-85e1-7f442b409d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '386e1605489846248e898a62c79643fe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:20.866019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1316/2612] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:20 2022] DELETE /identity/v3/users/386e1605489846248e898a62c79643fe => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:21.044748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.057661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa8b65-0130-4bf5-9849-cf90d6580e4f service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.121826 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.122463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.122746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.123024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] PATH_INFO: `/v3/projects/73688aab1b864a179b05b83ae930d59d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.124152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=73688aab1b864a179b05b83ae930d59d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.126091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.185799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73688aab1b864a179b05b83ae930d59d', 'request_id': 'req-17ec34e3-fadd-4c5a-8542-159cd1586b9f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:21.192554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73688aab1b864a179b05b83ae930d59d', 'request_id': 'req-17ec34e3-fadd-4c5a-8542-159cd1586b9f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:21.198761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73688aab1b864a179b05b83ae930d59d', 'request_id': 'req-17ec34e3-fadd-4c5a-8542-159cd1586b9f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:21.214212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] The token cache is being invalidate because project 73688aab1b864a179b05b83ae930d59d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:21.214502 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:21.215128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-17ec34e3-fadd-4c5a-8542-159cd1586b9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:21.216615 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1297/2613] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:21 2022] DELETE /identity/v3/projects/73688aab1b864a179b05b83ae930d59d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:21.222159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.222446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.222719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.243440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:21.244663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:21.307248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1317/2614] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:16:21.316003 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.316292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.316568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.337646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:21.338872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:21.347547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1298/2615] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:21.351964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.362240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee80f7-8816-4f74-808a-9a96cf79efc8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.366794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.367396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.367678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.367950 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.368596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:21.368901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.370533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.382143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1318/2616] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:21.386543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.398640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d35b1e-9d2b-4a32-8aee-6699e1bdb2ea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.404040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.404648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.404927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.405224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.405872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.408706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.414381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:21.444954 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1299/2617] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/projects => generated 371 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:21.446125 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.456927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485bf2e1-ab54-43d1-a5bb-5519dad55b1a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.506671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:21.520900 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.521658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.522209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.522555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.523397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.525549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.555734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1319/2618] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/users => generated 286 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:21.558125 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.575646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322fe07b-5e41-45dc-b420-c9302839e0df admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.581842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.582597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.583076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.583426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.584147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.586101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.597566 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1300/2619] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:21.601679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.613835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0269c3-9da6-4068-9103-868cfd521070 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.622570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.623240 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.623585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.623927 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.624746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.626590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19342b1-0537-4cf1-8122-14a0d6073c7a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.641951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1320/2620] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:21.645493 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.658567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121e0396-27b7-4f04-8f88-7cbc446c2d50 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.663841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.664597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.664948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.665336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] PATH_INFO: `/v3/projects/d7a4341937294c34bda49cfdfd0f5120/users/514cbdf5d9464de1aefdf88601dda4c5/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.682355 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d7a4341937294c34bda49cfdfd0f5120, user_id=514cbdf5d9464de1aefdf88601dda4c5, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.685158 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.712381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1301/2621] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:21 2022] PUT /identity/v3/projects/d7a4341937294c34bda49cfdfd0f5120/users/514cbdf5d9464de1aefdf88601dda4c5/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:21.714465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.714878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.715249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.748518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] MFA Rules not processed for user `514cbdf5d9464de1aefdf88601dda4c5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:21.749755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:21.831203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1321/2622] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:21.835951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.903212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c7935f-037b-41b4-9477-48b3354de260 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:21.908729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:21.908729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:21.908993 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:21.909250 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:21.909995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:21.911877 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:21.941490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1302/2623] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:21.950326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:21.962099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54abfbaf-de69-4a74-8898-b1bb22cc75e4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.023549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.024291 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.024726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.025280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.026213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.028328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.051709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1322/2624] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:21 2022] POST /identity/v3/users => generated 293 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:22.056353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.068134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b572644-0d6a-458d-bc29-35cda1e8bb34 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.072966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.073611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.073893 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.074168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.074806 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.076385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.088764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1303/2625] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:22.093446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.103918 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7cc47-5e47-4dd3-9fe0-6f15a7466d63 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.108586 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.109255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.109536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.109805 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] PATH_INFO: `/v3/projects/bb640da7271f4c80997182972f5c0d29/users/2406dbfde7f544328288ad8df4b59350/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.125729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb640da7271f4c80997182972f5c0d29, user_id=2406dbfde7f544328288ad8df4b59350, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.128897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.141280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1323/2626] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:22 2022] PUT /identity/v3/projects/bb640da7271f4c80997182972f5c0d29/users/2406dbfde7f544328288ad8df4b59350/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:22.145807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.155737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1157a9ad-ada7-4657-abe6-5d2cf584f16e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.209996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.210855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.211187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.211458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.212166 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.213774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a65af-97c6-490b-9df4-2fb1deee2a32 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.223602 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1304/2627] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:22 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:22.227757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.238752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a845b-e855-40b1-85e7-765c3828e451 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.243303 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.243937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.244211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.244479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] PATH_INFO: `/v3/projects/bb640da7271f4c80997182972f5c0d29/users/2406dbfde7f544328288ad8df4b59350/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.246399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb640da7271f4c80997182972f5c0d29, user_id=2406dbfde7f544328288ad8df4b59350, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.249002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.259919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1324/2628] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:22 2022] PUT /identity/v3/projects/bb640da7271f4c80997182972f5c0d29/users/2406dbfde7f544328288ad8df4b59350/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:22.270429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.270723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.271005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.298110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] MFA Rules not processed for user `2406dbfde7f544328288ad8df4b59350`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:22.299317 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:22.309290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:22.370457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1305/2629] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:22.382528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.384228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:22.399466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:22.444753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d2183-2331-4fed-a0d6-3acc553cbdbf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.448442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.449034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.449342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.449612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.458476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.459885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.469397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1325/2630] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:22.543759 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:22.553898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612a93f-9849-4244-a266-0bf256e99417 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:22.557492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:22.558086 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:22.558364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:22.558636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:22.617095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:22.618891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-424291b0-e024-4770-aa24-1f9a45687b77 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:22.627811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1306/2631] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:25.251424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:25.255176 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:25.337722 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f6303f-aeb4-4c20-ab68-369811eaa23a service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:25.343854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:25.344792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:25.345346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:25.345879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] PATH_INFO: `/v3/users/35cccd9b5e50416aa045f8882dc75807` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:25.347796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35cccd9b5e50416aa045f8882dc75807)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:25.349820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:25.433734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35cccd9b5e50416aa045f8882dc75807'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:25.443612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35cccd9b5e50416aa045f8882dc75807'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:25.452991 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35cccd9b5e50416aa045f8882dc75807'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:25.453741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35cccd9b5e50416aa045f8882dc75807'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:25.469263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35cccd9b5e50416aa045f8882dc75807'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:25.479789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1326/2632] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:25 2022] DELETE /identity/v3/users/35cccd9b5e50416aa045f8882dc75807 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:25.484349 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:25.484843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:25.485085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:25.506051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:25.507356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:25.577295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1307/2633] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:25.588103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:25.589717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:25.632785 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:25.661461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8293845-bf8e-4fb4-86c1-8975e489d108 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:25.665328 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:25.666121 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:25.666491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:25.666854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:25.677736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:25.679346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda1dca-2dfc-48a3-a64a-dbe8112dba8a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:25.690224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1327/2634] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:26.039103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:26.040555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:26.053310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcdd67-5279-44a2-a916-714c1c44aeb5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:26.057965 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:26.058716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:26.059001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:26.059277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] PATH_INFO: `/v3/projects/d30c6fdba16c4a31b4ee21e7aa0ffe2e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:26.060423 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d30c6fdba16c4a31b4ee21e7aa0ffe2e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:26.062511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:26.105756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:26.113448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd30c6fdba16c4a31b4ee21e7aa0ffe2e', 'request_id': 'req-8455b3a0-76a4-444e-baa1-47500b28b0d4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:26.120231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd30c6fdba16c4a31b4ee21e7aa0ffe2e', 'request_id': 'req-8455b3a0-76a4-444e-baa1-47500b28b0d4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:26.126283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd30c6fdba16c4a31b4ee21e7aa0ffe2e', 'request_id': 'req-8455b3a0-76a4-444e-baa1-47500b28b0d4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:26.138382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] The token cache is being invalidate because project d30c6fdba16c4a31b4ee21e7aa0ffe2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:26.138671 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:26.139286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:26.140766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1308/2635] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:26 2022] DELETE /identity/v3/projects/d30c6fdba16c4a31b4ee21e7aa0ffe2e => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:34.792728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:34.793307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:34.793307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:34.812712 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] MFA Rules not processed for user `80f428660fa3422ca82645b53c7ea2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:34.813937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:34.869725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1328/2636] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:35.198837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:35.200340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:35.284981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455b3a0-76a4-444e-baa1-47500b28b0d4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:35.289581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:35.290302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:35.290582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:35.290854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:35.292622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:35.303481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:35.304947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b200540a-70ad-4933-b428-325bcd253d8a service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:35.312851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1309/2637] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:44.860843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=36 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:45.309261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=35,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:52.011947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.013370 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:52.076730 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236224c4-4950-433c-950c-afb47b9e72a7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.081729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.082350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.082627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.082892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] PATH_INFO: `/v3/users/514cbdf5d9464de1aefdf88601dda4c5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.084003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] RBAC: Authorizing `identity:delete_user(user_id=514cbdf5d9464de1aefdf88601dda4c5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:52.086215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.130775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '514cbdf5d9464de1aefdf88601dda4c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.137631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '514cbdf5d9464de1aefdf88601dda4c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.145596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '514cbdf5d9464de1aefdf88601dda4c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.146242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '514cbdf5d9464de1aefdf88601dda4c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.158099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '514cbdf5d9464de1aefdf88601dda4c5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.163999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1329/2638] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:52 2022] DELETE /identity/v3/users/514cbdf5d9464de1aefdf88601dda4c5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:52.168425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.168888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.169004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.188319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:52.189554 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:52.248596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1310/2639] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:52.259632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.261091 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:52.318219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5d5066-7c1b-4212-8f37-98b0f2084090 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.321883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.322485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.322767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.323041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.332350 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:52.333770 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.343843 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1330/2640] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:52.609135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.610776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:52.623062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d606423-ceb5-4d23-9bd8-69862e494145 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.628479 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.629278 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.629609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.629955 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] PATH_INFO: `/v3/projects/d7a4341937294c34bda49cfdfd0f5120` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.631174 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d7a4341937294c34bda49cfdfd0f5120)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:52.633160 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.681198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd7a4341937294c34bda49cfdfd0f5120', 'request_id': 'req-967f619a-0c33-4351-a17e-06303eaccc37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.687351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd7a4341937294c34bda49cfdfd0f5120', 'request_id': 'req-967f619a-0c33-4351-a17e-06303eaccc37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.693320 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd7a4341937294c34bda49cfdfd0f5120', 'request_id': 'req-967f619a-0c33-4351-a17e-06303eaccc37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.705168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] The token cache is being invalidate because project d7a4341937294c34bda49cfdfd0f5120 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:52.705481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.706726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.708202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1311/2641] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:52 2022] DELETE /identity/v3/projects/d7a4341937294c34bda49cfdfd0f5120 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:52.712436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:52.722170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbeaa0d-1fc7-4ce1-9cf1-a83d4d9b4126 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:52.739829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:52.779681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:52.780322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:52.780610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:52.780880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] PATH_INFO: `/v3/users/2406dbfde7f544328288ad8df4b59350` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:52.782012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=2406dbfde7f544328288ad8df4b59350)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:52.783954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:52.828428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2406dbfde7f544328288ad8df4b59350'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.836163 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2406dbfde7f544328288ad8df4b59350'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.843479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2406dbfde7f544328288ad8df4b59350'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.844122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2406dbfde7f544328288ad8df4b59350'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.855976 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b3916e4b-f137-43f2-add1-8f278e2931ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2406dbfde7f544328288ad8df4b59350'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:52.861764 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1331/2642] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:16:52 2022] DELETE /identity/v3/users/2406dbfde7f544328288ad8df4b59350 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:53.130952 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.132441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:53.148242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967f619a-0c33-4351-a17e-06303eaccc37 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.329200 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.329888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.330103 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.330376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] PATH_INFO: `/v3/projects/bb640da7271f4c80997182972f5c0d29` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.332095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb640da7271f4c80997182972f5c0d29)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.334027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.363092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.380194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb640da7271f4c80997182972f5c0d29', 'request_id': 'req-27340a4a-8dea-4cbd-8c64-b5364b86eacf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:53.386371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb640da7271f4c80997182972f5c0d29', 'request_id': 'req-27340a4a-8dea-4cbd-8c64-b5364b86eacf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:53.392119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb640da7271f4c80997182972f5c0d29', 'request_id': 'req-27340a4a-8dea-4cbd-8c64-b5364b86eacf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:53.404605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] The token cache is being invalidate because project bb640da7271f4c80997182972f5c0d29 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:16:53.404997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:53.405651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-27340a4a-8dea-4cbd-8c64-b5364b86eacf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:16:53.407154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1312/2643] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:16:53 2022] DELETE /identity/v3/projects/bb640da7271f4c80997182972f5c0d29 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:53.412193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.412695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.412808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.554506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:53.555822 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:53.620600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1332/2644] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:53.628913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.629224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.629508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.649314 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:53.650519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:53.658375 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1313/2645] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:53.662674 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.672102 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ed7740-aa8d-4980-9039-2234521aa096 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.677155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.677777 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.678054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.678326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.678967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:16:53.679266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.680836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.692998 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1333/2646] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:16:53.697117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.706161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d745fd90-6407-4047-8e8e-ac2c8cfd9f53 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.711069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.711650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.711921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.712187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.712837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.714729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.741651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1314/2647] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/projects => generated 357 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:53.745682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.756499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65b7fc1-ac02-482e-bace-2247c20c96bb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.781101 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:53.812522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.813123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.813443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.813719 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.814377 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.816960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.837480 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1334/2648] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/users => generated 279 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:53.841719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.852275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44c88ef-6e67-4abc-a0d5-017409a7ac7a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.856808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.857431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.857706 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.857977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.858917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.860474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.870776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1315/2649] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:53.874597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.884961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc179283-d75f-43b2-9fa6-418000131db6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.889523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.890111 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.890390 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.890662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.891301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.892901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b84805-1519-4eb2-a87a-8cc39c87bb2e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.902585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1335/2650] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:53 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:53.906405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:53.916194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6099cb90-69ed-4fca-8298-647619f8b734 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:53.920646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:53.921306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.921579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.921850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] PATH_INFO: `/v3/projects/88b7bd131513483b89889d0c17cba61c/users/a5b23b849594420a834e7216ab8eece8/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.936515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=88b7bd131513483b89889d0c17cba61c, user_id=a5b23b849594420a834e7216ab8eece8, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:53.939185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:53.953907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1316/2651] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:53 2022] PUT /identity/v3/projects/88b7bd131513483b89889d0c17cba61c/users/a5b23b849594420a834e7216ab8eece8/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:16:53.965624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:53.965907 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:53.966208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:53.994061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] MFA Rules not processed for user `a5b23b849594420a834e7216ab8eece8`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:53.995254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:54.058346 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1336/2652] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:53 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:54.062908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.122960 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91543f2-2f68-4295-bd46-034cf4004e70 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.127411 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.128002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.128275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.128543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.129168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.131065 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.157002 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1317/2653] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:16:54 2022] POST /identity/v3/projects => generated 355 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:16:54.161980 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.172598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170ff991-780b-4944-bcaf-e067ed982c19 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.228185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.228783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.229065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.229364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.229992 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.231882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.252132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1337/2654] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:16:54 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:16:54.258327 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.268887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95c90fb-f548-4096-987e-1fa77a32d031 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.273595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.274194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.274474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.274751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.275394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.276974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.288021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1318/2655] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:16:54.292236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.302611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3de55a5-2b6a-4f7b-8110-472df94639c1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.307455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.308098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.308378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.308653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] PATH_INFO: `/v3/projects/3cfaf565d1e14aeea734205915f56c9e/users/bad9b5e06cc641f997d9ae66d09d633a/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.323155 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfaf565d1e14aeea734205915f56c9e, user_id=bad9b5e06cc641f997d9ae66d09d633a, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.325837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.339723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1338/2656] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:54 2022] PUT /identity/v3/projects/3cfaf565d1e14aeea734205915f56c9e/users/bad9b5e06cc641f997d9ae66d09d633a/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:54.343682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.354137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6891835b-73ac-416c-9c9e-104354783f26 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.374465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:54.413833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.414427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.414711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.414984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.415614 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.417212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaf2ccaa-71d3-494b-bcc5-1cff5e7fe8ea admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.426596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1319/2657] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:16:54.430704 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.436068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:16:54.442099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee692f-406e-4190-8f21-b8f178b4fba0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.446948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.447589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.447864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.448135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] PATH_INFO: `/v3/projects/3cfaf565d1e14aeea734205915f56c9e/users/bad9b5e06cc641f997d9ae66d09d633a/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.450043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3cfaf565d1e14aeea734205915f56c9e, user_id=bad9b5e06cc641f997d9ae66d09d633a, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.452688 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.463438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1339/2658] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:16:54 2022] PUT /identity/v3/projects/3cfaf565d1e14aeea734205915f56c9e/users/bad9b5e06cc641f997d9ae66d09d633a/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:16:54.474156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.474581 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.474971 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.501722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] MFA Rules not processed for user `bad9b5e06cc641f997d9ae66d09d633a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:16:54.503034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:54.569056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1320/2659] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:16:54 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:16:54.580587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.582813 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:16:54.640535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd742d70-a788-45a2-a212-a4fcda44f367 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.644153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.644746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.645024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.645336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.654095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.655507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.664800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1340/2660] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:16:54.738940 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:16:54.748928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227108d-42cc-4665-90b8-6f2ab51cf16c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:16:54.752577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:16:54.753840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:16:54.754122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:16:54.754400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:16:54.810343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:16:54.811813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd09805-4ade-4777-99ad-6f90ec356a08 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:16:54.820546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1321/2661] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:16:54 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:04.660713 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:04.816529 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=80 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:09.580249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.642098 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a357ce1-195e-4c92-9a13-85e91305a253 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.648228 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.648891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.649170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.649470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] PATH_INFO: `/v3/users/a5b23b849594420a834e7216ab8eece8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.650611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5b23b849594420a834e7216ab8eece8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.652520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.698174 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5b23b849594420a834e7216ab8eece8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:09.705006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5b23b849594420a834e7216ab8eece8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:09.712825 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5b23b849594420a834e7216ab8eece8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:09.713479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5b23b849594420a834e7216ab8eece8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:09.725557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5b23b849594420a834e7216ab8eece8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:09.731312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1341/2662] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:09 2022] DELETE /identity/v3/users/a5b23b849594420a834e7216ab8eece8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:09.735850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.736353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.736465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.755208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:09.756379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:09.811391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1322/2663] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:09.821588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:09.822952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:09.879756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec8bdb4-6785-4e26-b9d9-08e6639b9c56 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:09.883349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:09.883948 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:09.884227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:09.884498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:09.893364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:09.895454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:09.904614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1342/2664] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:10.165579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.166990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:10.180290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c39c96-8109-4fa6-937e-405091db4d9d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.184980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.185656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.185963 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.186851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] PATH_INFO: `/v3/projects/88b7bd131513483b89889d0c17cba61c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.188164 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=88b7bd131513483b89889d0c17cba61c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.190127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.236212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '88b7bd131513483b89889d0c17cba61c', 'request_id': 'req-e282a4b1-1c00-4eb6-9480-89971607d4c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.242725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '88b7bd131513483b89889d0c17cba61c', 'request_id': 'req-e282a4b1-1c00-4eb6-9480-89971607d4c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.248091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '88b7bd131513483b89889d0c17cba61c', 'request_id': 'req-e282a4b1-1c00-4eb6-9480-89971607d4c3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.260613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] The token cache is being invalidate because project 88b7bd131513483b89889d0c17cba61c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:10.260899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.261556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.263025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1323/2665] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:10 2022] DELETE /identity/v3/projects/88b7bd131513483b89889d0c17cba61c => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:10.267235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.276821 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4992ac24-310c-408b-9354-c90ceb3ae3f1 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.294476 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:10.334013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.334641 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.334916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.335186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] PATH_INFO: `/v3/users/bad9b5e06cc641f997d9ae66d09d633a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.336309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bad9b5e06cc641f997d9ae66d09d633a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.338261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.384233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bad9b5e06cc641f997d9ae66d09d633a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.390939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bad9b5e06cc641f997d9ae66d09d633a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.399388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bad9b5e06cc641f997d9ae66d09d633a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.400116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bad9b5e06cc641f997d9ae66d09d633a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.412114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-86e7f189-ffce-4179-afa4-a449f07f8179 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bad9b5e06cc641f997d9ae66d09d633a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.417883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1343/2666] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:10 2022] DELETE /identity/v3/users/bad9b5e06cc641f997d9ae66d09d633a => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:10.683157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.684556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:10.697507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e282a4b1-1c00-4eb6-9480-89971607d4c3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.752719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.753572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.753790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.754062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] PATH_INFO: `/v3/projects/3cfaf565d1e14aeea734205915f56c9e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.755185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3cfaf565d1e14aeea734205915f56c9e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.757055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.785778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:10.802912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3cfaf565d1e14aeea734205915f56c9e', 'request_id': 'req-cf8ecccb-3657-4552-9863-1bd8be06d886'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.808783 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3cfaf565d1e14aeea734205915f56c9e', 'request_id': 'req-cf8ecccb-3657-4552-9863-1bd8be06d886'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.814180 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3cfaf565d1e14aeea734205915f56c9e', 'request_id': 'req-cf8ecccb-3657-4552-9863-1bd8be06d886'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.825900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] The token cache is being invalidate because project 3cfaf565d1e14aeea734205915f56c9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:10.826187 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.826796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cf8ecccb-3657-4552-9863-1bd8be06d886 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:10.828302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1324/2667] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:10 2022] DELETE /identity/v3/projects/3cfaf565d1e14aeea734205915f56c9e => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:10.833512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.834233 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.834349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.853923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:10.855092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:10.912306 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1344/2668] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:10.921252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.921536 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.921808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.941277 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:10.942426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:10.950260 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1325/2669] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:10.954735 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.964978 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8a31c5-b5aa-418c-901d-b85fa58781a7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:10.969477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:10.970062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:10.970337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:10.970603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:10.971238 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:10.971531 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:10.973679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:10.984861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1345/2670] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:10.989229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:10.998289 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbe1aa2-c4fb-46cf-b259-9ede724bebe0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.002911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.003580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.003853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.004123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.004743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.006673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.032903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1326/2671] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:10 2022] POST /identity/v3/projects => generated 387 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.037720 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.047385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6948-1d19-4371-9bf2-aba01ae2819c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.072408 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:11.104506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.105110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.105414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.105684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.106302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.108221 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.128626 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1346/2672] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.132729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.142920 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e574ca-8717-4003-9094-85e49eec23ae admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.148041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.148649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.148910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.149178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.149840 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.151403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.161990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1327/2673] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:11.165836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.175830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69799fcb-b9c9-4007-94b1-165f92685f2d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.185869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.186466 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.186748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.187017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.187654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.189245 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4ca285-7f45-4aa0-a814-92f40586869b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.202342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1347/2674] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:11.207018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.217135 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9669d4-a53a-44e7-ae36-25ec433e10fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.222369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.223013 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.223290 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.223659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] PATH_INFO: `/v3/projects/538f260b6352460e876ad37000b40665/users/a3c54a188e3b4240ad26ba9f11515033/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.237794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=538f260b6352460e876ad37000b40665, user_id=a3c54a188e3b4240ad26ba9f11515033, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.240444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.254293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1328/2675] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:11 2022] PUT /identity/v3/projects/538f260b6352460e876ad37000b40665/users/a3c54a188e3b4240ad26ba9f11515033/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:11.264500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.264784 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.265053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.292923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] MFA Rules not processed for user `a3c54a188e3b4240ad26ba9f11515033`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:11.294170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:11.356862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1348/2676] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:11.361339 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.422622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8689c52-1a45-42a9-a153-691f6b0a3e77 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.427305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.427903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.428182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.428463 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.429088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.430988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.456959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1329/2677] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.461348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.472252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fb5bda-1d7b-45e2-aadb-72cc40ce29b9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.527484 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.528080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.528357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.528622 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.529271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.531158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.551441 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1349/2678] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/users => generated 294 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.555467 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.566303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac99a0a1-2d65-4140-b95d-e933fb4cbdb6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.570864 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.571460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.571739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.572012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.572648 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.574258 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.585793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1330/2679] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:11.589746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.599920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f683622-fa1b-4eeb-8c4e-2db99e320a55 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.604644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.605267 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.605548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.605816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.606477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.608040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693964d-b2fc-4f3d-b5b9-5828ba06485d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.618620 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1350/2680] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:11.622799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.634595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b98f882-a8f6-45af-b546-c4f414c6bbfd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.639254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.640175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.640461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.640739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] PATH_INFO: `/v3/projects/372f2a393089428f95e298c9fd957ab1/users/621378d33edf463587f919cfbb9ae03d/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.655178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=372f2a393089428f95e298c9fd957ab1, user_id=621378d33edf463587f919cfbb9ae03d, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.657931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.666728 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=6,keystone:SELECT=89,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:11.672231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1331/2681] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:11 2022] PUT /identity/v3/projects/372f2a393089428f95e298c9fd957ab1/users/621378d33edf463587f919cfbb9ae03d/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:11.683319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.683611 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.683889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.712828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] MFA Rules not processed for user `621378d33edf463587f919cfbb9ae03d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:11.714001 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:11.718028 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:11.780395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1351/2682] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:11.785006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.847381 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146f1382-655c-4e39-9abc-d9efaaeb0b45 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.851987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.852579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.852854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.853124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.853768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.855625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.882269 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1332/2683] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.886389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.897065 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fd8839-a5d4-4d3f-ae86-13dba7ff7670 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.954309 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.954912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.955186 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.955454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.956103 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:11.958022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:11.978824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1352/2684] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:11 2022] POST /identity/v3/users => generated 299 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:11.983066 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:11.993577 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b21f02-62b1-47e0-84a1-258afdc89541 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:11.998111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:11.998724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:11.999096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:11.999364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:11.999994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.001601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.012446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1333/2685] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:12.016348 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:12.026250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915015f2-680c-453e-8863-cce123a41c1f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:12.030753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:12.032025 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.032307 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.032577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] PATH_INFO: `/v3/projects/561d899680cd445ba44e256a9ed91e33/users/6d6af20813d043c39ae0dd1616db75d3/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.047752 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d899680cd445ba44e256a9ed91e33, user_id=6d6af20813d043c39ae0dd1616db75d3, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.051490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.063922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1353/2686] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:12 2022] PUT /identity/v3/projects/561d899680cd445ba44e256a9ed91e33/users/6d6af20813d043c39ae0dd1616db75d3/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:12.068022 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:12.077977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3a7b0c-f4d9-44ab-a633-200a04e32bc2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:12.133436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:12.134029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.134303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.134569 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.135191 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.136742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc40670-c533-445c-baf8-aca8bdf80b0b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.146266 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1334/2687] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:12 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:17:12.150591 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:12.161343 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b2aeb9-e581-4bcb-94ad-d79cba4bc578 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:12.166048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:12.166724 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.167002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.167274 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] PATH_INFO: `/v3/projects/561d899680cd445ba44e256a9ed91e33/users/6d6af20813d043c39ae0dd1616db75d3/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.169213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] RBAC: Authorizing `identity:create_grant(project_id=561d899680cd445ba44e256a9ed91e33, user_id=6d6af20813d043c39ae0dd1616db75d3, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.171816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.181967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1354/2688] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:12 2022] PUT /identity/v3/projects/561d899680cd445ba44e256a9ed91e33/users/6d6af20813d043c39ae0dd1616db75d3/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:12.193457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.193768 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.194037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.221976 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] MFA Rules not processed for user `6d6af20813d043c39ae0dd1616db75d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:12.223203 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:12.280171 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:12.293219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1335/2689] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:12 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:12.300868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:12.302585 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:12.361067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0744f7d1-2860-4640-8ca1-e035f670a52a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:12.365645 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:12.366340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.366689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.366962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.376061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.377593 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.383211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:12.387964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1355/2690] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:12.877303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:12.878841 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:12.890643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bb755-9e2e-4b9c-b9a0-e0208fc25a37 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:12.894286 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:12.894881 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:12.895161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:12.895433 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:12.953956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:12.955401 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:12.964340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1336/2691] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:12 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:16.954234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:16.963617 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e81caac-9d49-4ad3-8091-f98b069be5bc service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:16.967145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:16.967726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:16.967999 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:16.968270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:17.023402 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:17.024755 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bdcf4b-ddee-4d9e-97bf-057c2d930b3e service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:17.033253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1356/2692] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:16 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:19.138316 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.201235 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dedfe0-9935-425d-855f-8d109b5f7349 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.205792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.206364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.206640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.206913 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] PATH_INFO: `/v3/users/a3c54a188e3b4240ad26ba9f11515033` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.208990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a3c54a188e3b4240ad26ba9f11515033)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.210987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.256798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a3c54a188e3b4240ad26ba9f11515033'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.264760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a3c54a188e3b4240ad26ba9f11515033'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.277981 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a3c54a188e3b4240ad26ba9f11515033'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.278665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a3c54a188e3b4240ad26ba9f11515033'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.285446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a3c54a188e3b4240ad26ba9f11515033'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.292421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1337/2693] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:19 2022] DELETE /identity/v3/users/a3c54a188e3b4240ad26ba9f11515033 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:19.297096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.297577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.297754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.316282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:19.317726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:19.377607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1357/2694] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:17:19.387271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.388689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:19.403541 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:19.446107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ff8fb8-2347-4fb6-ab83-02c4eb8407f9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.449670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.450264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.450543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.450811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.461172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.462551 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.471970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1338/2695] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:19.749579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.751014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:19.763802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7fb70b6-33f8-47be-bc09-ada5dc6016d7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.768498 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.769201 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.769572 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.770505 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] PATH_INFO: `/v3/projects/538f260b6352460e876ad37000b40665` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.771639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=538f260b6352460e876ad37000b40665)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.773666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.819336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '538f260b6352460e876ad37000b40665', 'request_id': 'req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.826536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '538f260b6352460e876ad37000b40665', 'request_id': 'req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.832718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '538f260b6352460e876ad37000b40665', 'request_id': 'req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.843745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] The token cache is being invalidate because project 538f260b6352460e876ad37000b40665 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:19.844034 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.844658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.846151 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1358/2696] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:19 2022] DELETE /identity/v3/projects/538f260b6352460e876ad37000b40665 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:19.850929 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:19.860438 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462025b0-056e-4a34-9990-1ce7bb571603 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:19.922379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:19.923038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:19.923325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:19.923613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] PATH_INFO: `/v3/users/621378d33edf463587f919cfbb9ae03d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:19.924846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=621378d33edf463587f919cfbb9ae03d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:19.927085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:19.983385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621378d33edf463587f919cfbb9ae03d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:19.991268 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621378d33edf463587f919cfbb9ae03d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.003255 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621378d33edf463587f919cfbb9ae03d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.003933 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621378d33edf463587f919cfbb9ae03d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.012064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621378d33edf463587f919cfbb9ae03d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.018457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1339/2697] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:19 2022] DELETE /identity/v3/users/621378d33edf463587f919cfbb9ae03d => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:20.298979 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:20.300926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:20.314973 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c61b1b-4adc-4553-856b-4f83f90eaaa5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:20.338269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:20.380774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:20.381446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.381728 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.382069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] PATH_INFO: `/v3/projects/372f2a393089428f95e298c9fd957ab1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.383139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=372f2a393089428f95e298c9fd957ab1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:20.385171 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:20.433475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '372f2a393089428f95e298c9fd957ab1', 'request_id': 'req-4a3d4f68-6526-44af-b214-a2a293d6b652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.440881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '372f2a393089428f95e298c9fd957ab1', 'request_id': 'req-4a3d4f68-6526-44af-b214-a2a293d6b652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.448528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '372f2a393089428f95e298c9fd957ab1', 'request_id': 'req-4a3d4f68-6526-44af-b214-a2a293d6b652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.463834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] The token cache is being invalidate because project 372f2a393089428f95e298c9fd957ab1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:20.464165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.465508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.467120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1359/2698] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:20 2022] DELETE /identity/v3/projects/372f2a393089428f95e298c9fd957ab1 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:20.471196 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:20.472630 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:20.486214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b65f67a-9d04-4cf1-ba37-2a353270fd40 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:20.518970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:20.547714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:20.548784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:20.549063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:20.549368 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] PATH_INFO: `/v3/users/6d6af20813d043c39ae0dd1616db75d3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:20.550914 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6d6af20813d043c39ae0dd1616db75d3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:20.552838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:20.620249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6d6af20813d043c39ae0dd1616db75d3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.630719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6d6af20813d043c39ae0dd1616db75d3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.647763 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6d6af20813d043c39ae0dd1616db75d3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.648519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6d6af20813d043c39ae0dd1616db75d3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.657521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c7e15849-65fc-4974-a33e-60c093db8ca5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6d6af20813d043c39ae0dd1616db75d3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:20.665520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1340/2699] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:20 2022] DELETE /identity/v3/users/6d6af20813d043c39ae0dd1616db75d3 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:20.943866 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:20.945489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:20.960678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3d4f68-6526-44af-b214-a2a293d6b652 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.026500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.027050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.027333 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.027607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] PATH_INFO: `/v3/projects/561d899680cd445ba44e256a9ed91e33` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.028740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=561d899680cd445ba44e256a9ed91e33)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.030800 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.083483 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '561d899680cd445ba44e256a9ed91e33', 'request_id': 'req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:21.087827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:21.091319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '561d899680cd445ba44e256a9ed91e33', 'request_id': 'req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:21.099134 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '561d899680cd445ba44e256a9ed91e33', 'request_id': 'req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:21.112436 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] The token cache is being invalidate because project 561d899680cd445ba44e256a9ed91e33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:21.112725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:21.113443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-596c4735-a9a8-4bb0-8f1d-18b1c95e82fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:21.114952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1360/2700] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:20 2022] DELETE /identity/v3/projects/561d899680cd445ba44e256a9ed91e33 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:21.120793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.121083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.121398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.141364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:21.142565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:21.207804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1341/2701] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:21.217235 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.217526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.217799 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.241590 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:21.243413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:21.255854 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1361/2702] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:21.260124 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.270244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccabc9f3-ed41-440c-9a31-143f4113cf73 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.274716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.275304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.275580 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.275850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.276492 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:21.276847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.278405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.289626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1342/2703] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:21.293831 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.302893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148769ad-34d6-4c91-a577-0dab291c8364 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.307548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.308167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.308465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.308737 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.309414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.311284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.339169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1362/2704] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/projects => generated 381 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:21.343297 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.353251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9a594a-6a85-4a69-ab3b-9ebe8c791dab admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.393774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:21.411715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.412310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.412587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.412860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.413531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.415415 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.436220 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1343/2705] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/users => generated 291 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:21.440401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.451188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a6029a-6dd0-4770-927c-cbbad6d22739 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.455681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.456276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.456552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.456820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.458035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.459860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.469516 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1363/2706] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:21.474107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.483961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8e9463-f890-4f63-ac27-0f6f5a259d1a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.490371 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.490975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.491245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.491512 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.492149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.493758 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc432d1-9c4b-4f98-9f8d-b14150dbac5c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.504231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1344/2707] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:21.508643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.520478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a4a5c8-5351-4e42-b195-9383d681a9ba admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.526455 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.527156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.527448 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.527941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] PATH_INFO: `/v3/projects/5f898fe7b19d40e1856bb98330f4b5d3/users/d54337e037eb4782b21a271577bcb13a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.543579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f898fe7b19d40e1856bb98330f4b5d3, user_id=d54337e037eb4782b21a271577bcb13a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.546252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.558893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1364/2708] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:21 2022] PUT /identity/v3/projects/5f898fe7b19d40e1856bb98330f4b5d3/users/d54337e037eb4782b21a271577bcb13a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:21.571436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.571722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.571996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.600726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] MFA Rules not processed for user `d54337e037eb4782b21a271577bcb13a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:21.601977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:21.665457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1345/2709] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:21.671302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.734385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ce5d-382e-44f2-b158-4ce447102f30 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.739353 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.739989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.740229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.740518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.741142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.743078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.771419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1365/2710] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:21.775810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.786774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0d3a82-c43b-4ffe-a450-1afc8d4009fe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.843873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.844556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.844898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.845274 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.845974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.847892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.870948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1346/2711] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:21 2022] POST /identity/v3/users => generated 298 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:21.877518 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.889256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96f6fc1-3931-4afd-8092-05e751cff819 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.894188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.895459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.895740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.896086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.896806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.898577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.910968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1366/2712] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:21.915518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.927904 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c403a97-cfa4-4347-81b2-2972753de225 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:21.932548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:21.933240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:21.933518 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:21.933789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] PATH_INFO: `/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8/users/b5861dc723ca40ec9cc3e561aecb4f03/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:21.951844 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b4d329488a4d6c9dd7fe475480cfa8, user_id=b5861dc723ca40ec9cc3e561aecb4f03, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:21.954610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:21.970312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1347/2713] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:21 2022] PUT /identity/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8/users/b5861dc723ca40ec9cc3e561aecb4f03/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:21.974635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:21.985077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be80c2cc-3c59-4432-a037-ce14fb16e4fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.034807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:22.045871 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.046409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.046687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.046957 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.047597 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.049173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224e1d36-f890-429c-8c6d-b0523c19eb3e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.060015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1367/2714] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:21 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:17:22.063619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.074748 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d04e194-49b2-4b14-929c-774a10f53f83 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.079511 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.080192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.080474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.080735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] PATH_INFO: `/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8/users/b5861dc723ca40ec9cc3e561aecb4f03/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.084106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9b4d329488a4d6c9dd7fe475480cfa8, user_id=b5861dc723ca40ec9cc3e561aecb4f03, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.086344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.100294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1348/2715] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:22 2022] PUT /identity/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8/users/b5861dc723ca40ec9cc3e561aecb4f03/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:22.110689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.110977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.111257 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.139886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] MFA Rules not processed for user `b5861dc723ca40ec9cc3e561aecb4f03`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:22.141081 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:22.209818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1368/2716] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:22 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:22.221519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.223336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:22.228644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:22.281172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59ac2b5-6664-4767-b882-c90f6dca12b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.284727 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.285372 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.285651 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.285987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.294595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.296037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.305743 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1349/2717] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:22.395142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.405131 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce1e66f-20fc-4358-b63b-5870e79fbde7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.408723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.409357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.409638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.409911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.469912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.471351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31a8b5-9455-48c6-9f4c-ee14a91d32d8 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.483209 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1369/2718] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:22.744201 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:22.804357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a4dbcd-48d6-456f-b499-3381ef9acaef service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:22.808736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:22.809378 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.809658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.809950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] PATH_INFO: `/v3/users/d54337e037eb4782b21a271577bcb13a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.811051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d54337e037eb4782b21a271577bcb13a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:22.812944 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:22.864345 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd54337e037eb4782b21a271577bcb13a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:22.874218 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd54337e037eb4782b21a271577bcb13a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:22.886244 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd54337e037eb4782b21a271577bcb13a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:22.886925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd54337e037eb4782b21a271577bcb13a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:22.893689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd54337e037eb4782b21a271577bcb13a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:22.900118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1350/2719] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:22 2022] DELETE /identity/v3/users/d54337e037eb4782b21a271577bcb13a => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:22.904637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:22.904926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:22.905236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:22.926443 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:22.927653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:22.987243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1370/2720] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:23.000026 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.001635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:23.029851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.061813 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3621173d-ba95-49c3-9496-c53dbc33ff52 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.065356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.065961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.066240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.066550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.075853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:23.077352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:23.088179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1351/2721] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:23.381717 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.383138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:23.397772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe182f-efe8-4106-8b2d-364478cf0d98 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.404478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.406049 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.406335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.406604 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] PATH_INFO: `/v3/projects/5f898fe7b19d40e1856bb98330f4b5d3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.407903 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f898fe7b19d40e1856bb98330f4b5d3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:23.409783 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:23.418869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:23.463449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f898fe7b19d40e1856bb98330f4b5d3', 'request_id': 'req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.471858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f898fe7b19d40e1856bb98330f4b5d3', 'request_id': 'req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.477725 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f898fe7b19d40e1856bb98330f4b5d3', 'request_id': 'req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.489361 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] The token cache is being invalidate because project 5f898fe7b19d40e1856bb98330f4b5d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:23.489661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.490312 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.491807 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1371/2722] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:23 2022] DELETE /identity/v3/projects/5f898fe7b19d40e1856bb98330f4b5d3 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:23.495970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:23.506334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f74256-edad-47d4-af2d-dfb94aabc8e2 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:23.562364 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:23.562994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:23.563271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:23.563543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] PATH_INFO: `/v3/users/b5861dc723ca40ec9cc3e561aecb4f03` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:23.564696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b5861dc723ca40ec9cc3e561aecb4f03)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:23.567269 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:23.617697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b5861dc723ca40ec9cc3e561aecb4f03'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.626269 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b5861dc723ca40ec9cc3e561aecb4f03'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.640384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b5861dc723ca40ec9cc3e561aecb4f03'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.641094 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b5861dc723ca40ec9cc3e561aecb4f03'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.648769 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fc003581-d32a-4adf-b81d-ffdd29ef5ca8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b5861dc723ca40ec9cc3e561aecb4f03'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:23.654912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1352/2723] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:23 2022] DELETE /identity/v3/users/b5861dc723ca40ec9cc3e561aecb4f03 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:24.062085 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.063646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:24.077159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13dfc03-f35f-4ef5-8f12-1b0e878d236f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.142939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.143570 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.143844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.144112 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] PATH_INFO: `/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.145506 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9b4d329488a4d6c9dd7fe475480cfa8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.147401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.200122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9b4d329488a4d6c9dd7fe475480cfa8', 'request_id': 'req-4a622ba4-99fb-4718-9512-7078a06f00ce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:24.210271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9b4d329488a4d6c9dd7fe475480cfa8', 'request_id': 'req-4a622ba4-99fb-4718-9512-7078a06f00ce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:24.216691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9b4d329488a4d6c9dd7fe475480cfa8', 'request_id': 'req-4a622ba4-99fb-4718-9512-7078a06f00ce'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:24.229124 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] The token cache is being invalidate because project c9b4d329488a4d6c9dd7fe475480cfa8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:24.229454 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:24.230089 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4a622ba4-99fb-4718-9512-7078a06f00ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:24.231914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1372/2724] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:24 2022] DELETE /identity/v3/projects/c9b4d329488a4d6c9dd7fe475480cfa8 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:24.236557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.237108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.237240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.259122 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:24.260690 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:24.308638 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:24.331092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1353/2725] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:24.339819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.340096 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.340365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.363515 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:24.364736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:24.378555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1373/2726] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:24.382100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.393366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc37e621-63b8-4b1a-85ef-f293909317f9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.401793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.402417 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.402695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.402968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.403872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:24.404179 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.406500 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.425470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1354/2727] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:24.430857 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.442026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07ea2d2-f2fa-4862-8c41-afd2b2af8bf7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.451004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.452086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.452086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.452473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.453301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.455256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.481438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:24.491917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1374/2728] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:24 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:24.496186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.506319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50e45f2-3e15-418b-a921-d2a4deca717b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.588766 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.589429 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.589713 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.589991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.590633 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.592562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.624149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1355/2729] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:24 2022] POST /identity/v3/users => generated 286 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:24.625046 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.638270 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6818b8fc-3f08-4b45-98e7-81c37fa3cb93 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.646153 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.646955 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.647298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.647619 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.648347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.650061 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.662388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1375/2730] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:24.667136 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.680410 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e2b97-6e4e-42ae-a419-30c12e11cf55 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.686682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.687296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.687578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.687851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.688495 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.690115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6cbeb98-30ce-4e06-8f72-43e694fb1890 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.704717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1356/2731] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:24.706054 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.718255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fdc0b8-c32e-4fa7-9687-6f625e011c4f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:24.724819 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:24.725603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.725953 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.726288 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] PATH_INFO: `/v3/projects/4b4a487c4a914cdd91a9efa2a88a5e02/users/c34fd595c3bc470a91d8231da0e2dbd6/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.745678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b4a487c4a914cdd91a9efa2a88a5e02, user_id=c34fd595c3bc470a91d8231da0e2dbd6, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:24.748546 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:24.766490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1376/2732] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:24 2022] PUT /identity/v3/projects/4b4a487c4a914cdd91a9efa2a88a5e02/users/c34fd595c3bc470a91d8231da0e2dbd6/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:24.839425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:24.839785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:24.840308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:24.870356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] MFA Rules not processed for user `c34fd595c3bc470a91d8231da0e2dbd6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:24.871709 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:24.936775 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1357/2733] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:24 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:24.947961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:24.950575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.010372 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be8277b-5f1f-4e8b-840e-9a0ac011fbcf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.014250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.014867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.015250 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.015529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.025349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.026801 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee66c53-8fe0-4d46-8dbe-06bff130634b service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.038074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1377/2734] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:24 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:25.062722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.117406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.142340 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdb7ab-9c0b-4b1b-a26a-2d5afc48b0de None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.148388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.149248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.149531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.149804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] PATH_INFO: `/v3/users/c34fd595c3bc470a91d8231da0e2dbd6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.150967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] RBAC: Authorizing `identity:delete_user(user_id=c34fd595c3bc470a91d8231da0e2dbd6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.152892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.203555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c34fd595c3bc470a91d8231da0e2dbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.211595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c34fd595c3bc470a91d8231da0e2dbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.225674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c34fd595c3bc470a91d8231da0e2dbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.226448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c34fd595c3bc470a91d8231da0e2dbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.233990 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c34fd595c3bc470a91d8231da0e2dbd6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.240319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1358/2735] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:25 2022] DELETE /identity/v3/users/c34fd595c3bc470a91d8231da0e2dbd6 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:25.244864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.245242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.245588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.264375 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:25.265711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.325478 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1378/2736] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:17:25.336054 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.337489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.405221 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700a6c28-a6fb-48b2-92d9-f6d808fcc2df admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.408984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.409693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.410076 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.410441 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.420272 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.421887 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c8e3d1-267e-4fce-9010-3fe9f4c0b1dd service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.433912 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1359/2737] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:25.779502 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:25.781820 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:25.798012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6788240-6988-4f34-8ae5-a42efc42d748 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:25.804311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:25.805347 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.805924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.806589 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] PATH_INFO: `/v3/projects/4b4a487c4a914cdd91a9efa2a88a5e02` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.808217 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b4a487c4a914cdd91a9efa2a88a5e02)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:25.811022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:25.874229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b4a487c4a914cdd91a9efa2a88a5e02', 'request_id': 'req-2f619b2e-3835-47a6-a7eb-7cce55685610'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.884305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b4a487c4a914cdd91a9efa2a88a5e02', 'request_id': 'req-2f619b2e-3835-47a6-a7eb-7cce55685610'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.889493 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:25.892507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b4a487c4a914cdd91a9efa2a88a5e02', 'request_id': 'req-2f619b2e-3835-47a6-a7eb-7cce55685610'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.907664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] The token cache is being invalidate because project 4b4a487c4a914cdd91a9efa2a88a5e02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:25.907952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.908603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2f619b2e-3835-47a6-a7eb-7cce55685610 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:25.911296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1379/2738] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:25 2022] DELETE /identity/v3/projects/4b4a487c4a914cdd91a9efa2a88a5e02 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:25.916055 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:25.916341 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:25.916618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:25.936558 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:25.937786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:26.000719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1360/2739] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:26.008447 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.008741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.009021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.029322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:26.030541 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:26.039373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1380/2740] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:26.043673 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.049656 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.053757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96580969-aefb-49ca-aaad-c96052a82670 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.059862 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.060583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.061034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.061579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.062379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:26.062682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.064291 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.079691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1361/2741] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:26.081169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.093524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec299fc-375b-4509-aac6-44ee5cd423ce None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.099290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.099587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.099867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.100156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.100776 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.102738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.134685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1381/2742] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:26.139276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.150403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7344f06-ccf6-49ca-89ec-1b8e9c75d712 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.211521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.212126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.212403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.212674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.213333 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.215797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.238966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1362/2743] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:26.243068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.256139 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebfba97-bc23-4722-ba14-109ce9149c01 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.262172 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.263142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.263427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.263701 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.264668 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.267088 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.280655 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1382/2744] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:26.284194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.294626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e767cf0-887b-4959-84e6-2dfc443ef2d1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.301903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.302550 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.303025 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.303351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.303996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.305632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccb097-9b82-4478-9b79-1bed137e3999 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.317661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1363/2745] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:26.322302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.332446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93cdebc1-5a51-4763-8272-340fa45fb105 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.337397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.338083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.338367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.338643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] PATH_INFO: `/v3/projects/6538149de3c545dbb8a1931d9868923e/users/1a02b7a593114608997297bf5abcfe0b/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.355010 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6538149de3c545dbb8a1931d9868923e, user_id=1a02b7a593114608997297bf5abcfe0b, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.357709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.372519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1383/2746] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:26 2022] PUT /identity/v3/projects/6538149de3c545dbb8a1931d9868923e/users/1a02b7a593114608997297bf5abcfe0b/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:26.384140 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.384426 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.384693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.416254 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] MFA Rules not processed for user `1a02b7a593114608997297bf5abcfe0b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:26.417522 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:26.485058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1364/2747] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:26.489836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.556019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2d0e2a-9437-4180-b5cd-2ad60668d5f3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.560751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.561388 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.561665 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.561943 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.562575 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.564462 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.594352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1384/2748] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:26.599445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.611031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336f2e66-bf96-4bba-8860-8f2dde8b4e69 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.671973 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.672589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.672868 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.673143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.673835 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.675898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.684106 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:26.698762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1365/2749] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:26.702882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.714418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883f05f3-75a3-4974-bb23-0082c5f592ab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.719249 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.719889 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.720167 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.720442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.721086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.723446 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.734780 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1385/2750] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:17:26.739127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.748989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8935c180-fabd-47ce-8d9a-559ddf873690 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.753619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.754264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.754632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.754909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.755552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.757264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a6e3ff-e213-4190-94be-2c174e188bb3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.768056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1366/2751] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:26.772881 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.782878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330e9c74-52b2-42b6-aa9a-5f53b4e33c41 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:26.788600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:26.789302 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.789557 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.789827 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] PATH_INFO: `/v3/projects/c09ebd0faa694d7580227a00809ef87c/users/a44f24c4774a4ee0b1c04b543f1f7abe/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.804596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c09ebd0faa694d7580227a00809ef87c, user_id=a44f24c4774a4ee0b1c04b543f1f7abe, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:26.807261 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:26.821019 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1386/2752] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:26 2022] PUT /identity/v3/projects/c09ebd0faa694d7580227a00809ef87c/users/a44f24c4774a4ee0b1c04b543f1f7abe/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:26.833530 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730216-9af0-4379-91aa-465512394562 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:26.834048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730216-9af0-4379-91aa-465512394562 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:26.834427 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc730216-9af0-4379-91aa-465512394562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:26.863961 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bc730216-9af0-4379-91aa-465512394562 None None] MFA Rules not processed for user `a44f24c4774a4ee0b1c04b543f1f7abe`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:26.865321 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bc730216-9af0-4379-91aa-465512394562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:26.932092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1367/2753] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:26.938264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:26.981041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.010223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b84472-976d-475e-a1d9-49c85407d1cc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.015050 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.015664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.015951 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.016244 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.016894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.018894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.046727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1387/2754] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:27.051481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc730216-9af0-4379-91aa-465512394562 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.062167 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc730216-9af0-4379-91aa-465512394562 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.124589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.125230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.125519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.125797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.126439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.128359 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.150127 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1368/2755] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:27 2022] POST /identity/v3/users => generated 298 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:27.154093 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.164458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f6e036-d1be-4736-8db5-ac05f1cca023 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.169253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.169867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.170146 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.170419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.171067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.172703 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.183666 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1388/2756] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 01 05:17:27.188161 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.198928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c8c71-1396-4fb7-9352-8487f11dc66a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.203567 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.204224 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.204501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.204774 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] PATH_INFO: `/v3/projects/e3cabeed0c1046338aad35186d85014f/users/bb186b4bac7043329c942815530799fd/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.220878 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cabeed0c1046338aad35186d85014f, user_id=bb186b4bac7043329c942815530799fd, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.224056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.237009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1369/2757] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:27 2022] PUT /identity/v3/projects/e3cabeed0c1046338aad35186d85014f/users/bb186b4bac7043329c942815530799fd/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:27.241568 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.251234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a08f2a3-e11c-4643-adcd-5f8357c2c0f2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.309354 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.309878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.310154 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.310425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.311084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.312667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398e893c-7f65-477b-adad-7c543045c0f0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.323486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1389/2758] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:27.327950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.338807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1d6c1b-346b-4981-8f2a-867acac85bfd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.343754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.344409 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.344684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.344956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] PATH_INFO: `/v3/projects/e3cabeed0c1046338aad35186d85014f/users/bb186b4bac7043329c942815530799fd/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.346932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3cabeed0c1046338aad35186d85014f, user_id=bb186b4bac7043329c942815530799fd, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.349601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301a4bcd-c28e-4c1e-a81d-0ce5fe99e218 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.360980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1370/2759] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:27 2022] PUT /identity/v3/projects/e3cabeed0c1046338aad35186d85014f/users/bb186b4bac7043329c942815530799fd/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:27.372043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.372332 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.372637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.402047 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] MFA Rules not processed for user `bb186b4bac7043329c942815530799fd`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:27.403254 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:27.460810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.461096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.461413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.473909 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1390/2760] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:27 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:27.484379 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] MFA Rules not processed for user `80f428660fa3422ca82645b53c7ea2dc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:27.485129 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:27.485636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:27.486503 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:27.500416 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.522838 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:27.545729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1371/2761] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:27 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:17:27.548378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3affc-d7ec-4274-8102-784d582d445c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:27.552908 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:27.553552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:27.553837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:27.554108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:27.614654 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:27.616072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:27.624944 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1391/2762] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:17:29.136175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.137741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:29.150917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ec2199-8d80-4beb-9f67-0dd48f08156a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.154629 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.155240 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.155519 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.156251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.228532 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.230488 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.249319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1372/2763] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:29.796308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:29.805128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b167ca-4393-4f18-889e-fb9aab723a51 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:29.809063 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:29.809781 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:29.810193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:29.810472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:29.819893 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:29.821492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45da0ca5-0914-4240-943c-92db9d375f80 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:29.832734 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1392/2764] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:29 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:33.736619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:33.796970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba967fc-ab17-4a3c-9898-7998ee1b2680 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:33.802107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:33.802719 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.802994 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.803264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] PATH_INFO: `/v3/users/1a02b7a593114608997297bf5abcfe0b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.804358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a02b7a593114608997297bf5abcfe0b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:33.806293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:33.850997 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a02b7a593114608997297bf5abcfe0b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:33.857588 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a02b7a593114608997297bf5abcfe0b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:33.865036 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:33.871031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a02b7a593114608997297bf5abcfe0b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:33.871684 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a02b7a593114608997297bf5abcfe0b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:33.878716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a02b7a593114608997297bf5abcfe0b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:33.884517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1373/2765] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:33 2022] DELETE /identity/v3/users/1a02b7a593114608997297bf5abcfe0b => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:33.888937 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:33.889449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:33.889556 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:33.908232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:33.909438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:33.968106 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1393/2766] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:33.978159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:33.979533 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:34.036444 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a0d85-9332-4c12-85d3-bb1bdd1dd58a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.040128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.040731 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.041010 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.041313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.051188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.052611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.062721 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1374/2767] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:34.330026 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.332580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:34.346691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da83dbd-5cc3-4273-b9d0-f1bfab64774b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.351952 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.352580 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.352859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.353132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] PATH_INFO: `/v3/projects/6538149de3c545dbb8a1931d9868923e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.354272 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] RBAC: Authorizing `identity:delete_project(project_id=6538149de3c545dbb8a1931d9868923e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.356697 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.408867 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6538149de3c545dbb8a1931d9868923e', 'request_id': 'req-d4926126-89fc-4310-9559-ab774c9fcabf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.417692 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6538149de3c545dbb8a1931d9868923e', 'request_id': 'req-d4926126-89fc-4310-9559-ab774c9fcabf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.423969 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6538149de3c545dbb8a1931d9868923e', 'request_id': 'req-d4926126-89fc-4310-9559-ab774c9fcabf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.426132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:34.438628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] The token cache is being invalidate because project 6538149de3c545dbb8a1931d9868923e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:34.438919 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.439588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.441797 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1394/2768] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:34 2022] DELETE /identity/v3/projects/6538149de3c545dbb8a1931d9868923e => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:34.445874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.459088 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-307d0725-f2a4-4333-b805-36a6f7216731 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.525313 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.525948 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.526225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.526501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] PATH_INFO: `/v3/users/a44f24c4774a4ee0b1c04b543f1f7abe` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.527643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a44f24c4774a4ee0b1c04b543f1f7abe)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.529794 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:34.578384 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a44f24c4774a4ee0b1c04b543f1f7abe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.586547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a44f24c4774a4ee0b1c04b543f1f7abe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.598618 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a44f24c4774a4ee0b1c04b543f1f7abe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.599456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a44f24c4774a4ee0b1c04b543f1f7abe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.608033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a44f24c4774a4ee0b1c04b543f1f7abe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:34.614079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1375/2769] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:34 2022] DELETE /identity/v3/users/a44f24c4774a4ee0b1c04b543f1f7abe => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:34.880632 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:34.882077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:34.895816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4926126-89fc-4310-9559-ab774c9fcabf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:34.954276 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:34.954917 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:34.955198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:34.955473 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] PATH_INFO: `/v3/projects/c09ebd0faa694d7580227a00809ef87c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:34.957100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] RBAC: Authorizing `identity:delete_project(project_id=c09ebd0faa694d7580227a00809ef87c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:34.959327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.004869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c09ebd0faa694d7580227a00809ef87c', 'request_id': 'req-574ea973-f8a2-4bdf-8010-4d149049b50d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.012658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c09ebd0faa694d7580227a00809ef87c', 'request_id': 'req-574ea973-f8a2-4bdf-8010-4d149049b50d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.018160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c09ebd0faa694d7580227a00809ef87c', 'request_id': 'req-574ea973-f8a2-4bdf-8010-4d149049b50d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.029729 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] The token cache is being invalidate because project c09ebd0faa694d7580227a00809ef87c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:35.030017 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.030675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.032179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1395/2770] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:34 2022] DELETE /identity/v3/projects/c09ebd0faa694d7580227a00809ef87c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:35.036968 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.038476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:35.047338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:35.051181 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b33cf97-3c97-4423-9148-ca35cf7da156 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.108249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.108883 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.109165 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.109472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] PATH_INFO: `/v3/users/bb186b4bac7043329c942815530799fd` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.110592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb186b4bac7043329c942815530799fd)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.112501 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.156470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb186b4bac7043329c942815530799fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.164119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb186b4bac7043329c942815530799fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.175613 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb186b4bac7043329c942815530799fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.176308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb186b4bac7043329c942815530799fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.183430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b578e28b-6897-4046-8776-20cc071f5daf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb186b4bac7043329c942815530799fd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.189245 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1376/2771] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:17:35 2022] DELETE /identity/v3/users/bb186b4bac7043329c942815530799fd => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:35.552775 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.554411 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:35.568986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ea973-f8a2-4bdf-8010-4d149049b50d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.643680 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.644846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.645215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.645573 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] PATH_INFO: `/v3/projects/e3cabeed0c1046338aad35186d85014f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.646806 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3cabeed0c1046338aad35186d85014f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.648855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.679753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:35.695086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3cabeed0c1046338aad35186d85014f', 'request_id': 'req-ebcc61e4-f59d-47ab-a619-73f94b76389a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.701794 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3cabeed0c1046338aad35186d85014f', 'request_id': 'req-ebcc61e4-f59d-47ab-a619-73f94b76389a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.708165 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3cabeed0c1046338aad35186d85014f', 'request_id': 'req-ebcc61e4-f59d-47ab-a619-73f94b76389a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.719135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] The token cache is being invalidate because project e3cabeed0c1046338aad35186d85014f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:17:35.719420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.720056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ebcc61e4-f59d-47ab-a619-73f94b76389a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:17:35.721642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1396/2772] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:17:35 2022] DELETE /identity/v3/projects/e3cabeed0c1046338aad35186d85014f => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:35.732531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.732753 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.733027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.752855 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:35.754398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:35.812915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1377/2773] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:35.822043 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.822351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.822624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.843461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:35.844761 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:35.853774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1397/2774] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:17:35.857956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.867640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbf95be-b651-4afd-af3b-b8e4c8fe7976 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.872108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.872693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.872967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.873261 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.873905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:17:35.874206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.875776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.891008 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1378/2775] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:17:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:17:35.895939 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.905691 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4330e2-f5e3-452e-9288-ff224d88d751 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.911216 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:35.911816 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:35.912095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:35.912367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:35.913013 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:35.915015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:35.948060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1398/2776] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:35 2022] POST /identity/v3/projects => generated 371 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:17:35.954282 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:35.971649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eda6362-2364-4086-a56d-65990a96a26c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:35.980704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:36.032263 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.032786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.033064 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.033369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.033991 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.035910 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.056141 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1379/2777] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:35 2022] POST /identity/v3/users => generated 286 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:36.060468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.071076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc80af14-a27d-49c2-b685-ba9af03a3507 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.075670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.076258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.076535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.076808 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.077475 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.079056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.089766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1399/2778] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:36.093680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.103714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9455091e-7511-42de-9b1f-f4412bc5bfe2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.108273 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.108860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.109137 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.109431 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.110063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.111611 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15b072-b6cc-4bc0-97e6-4aa18405ed41 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.121793 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1380/2779] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:36.125829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.136371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade1f226-c628-492c-80d1-4ec79e63aa0d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.140947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.141624 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.141901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.142170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] PATH_INFO: `/v3/projects/252181fc575c44a6bf6390d770531fb2/users/1c60b3d40f3f45c2bb3bc283e11ec805/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.156684 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] RBAC: Authorizing `identity:create_grant(project_id=252181fc575c44a6bf6390d770531fb2, user_id=1c60b3d40f3f45c2bb3bc283e11ec805, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.159326 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.171547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1400/2780] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:36 2022] PUT /identity/v3/projects/252181fc575c44a6bf6390d770531fb2/users/1c60b3d40f3f45c2bb3bc283e11ec805/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:36.176538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bfb0-750d-4729-b676-19c56dd1e513 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.176821 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bfb0-750d-4729-b676-19c56dd1e513 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.177112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef53bfb0-750d-4729-b676-19c56dd1e513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.196754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ef53bfb0-750d-4729-b676-19c56dd1e513 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:36.197995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ef53bfb0-750d-4729-b676-19c56dd1e513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:36.265744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1381/2781] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:36.276465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:36.278195 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:36.334062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5954474a-f603-44ed-ae53-3650995ff06a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:36.337555 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:36.338148 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:36.338424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:36.338695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:36.347444 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:36.348869 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:36.358196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1401/2782] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:40.832100 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:40.833023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:40.833023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:40.863789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] MFA Rules not processed for user `1c60b3d40f3f45c2bb3bc283e11ec805`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:40.865143 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:40.934548 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1382/2783] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:40 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:40.938830 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:40.954495 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859decc0-5160-4fff-a6cf-f5587d482ae7 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:40.960607 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:40.961403 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:40.961687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:40.961963 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:40.962741 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:40.964653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:40.993638 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1402/2784] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:17:40 2022] POST /identity/v3/projects => generated 369 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:40.997678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.009157 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc195b33-62a4-4877-aafd-10250b1929f5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.026198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.066311 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.066905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.067178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.067446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.068084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.070009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.092091 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1383/2785] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:17:40 2022] POST /identity/v3/users => generated 291 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:17:41.096200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.107470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df77475-4e3b-425f-bbf2-d7a62155d454 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.112053 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.112646 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.112928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.113234 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.113880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.115465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.125766 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1403/2786] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:41.130092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.139846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e94df2-a705-462d-bb80-baf28e591855 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.145102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.145778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.146059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.146329 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] PATH_INFO: `/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c/users/efad514542c747c4a5b5deef38b447a8/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.161358 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a957d8ca0d2f40e086eefbcb7f0e3a9c, user_id=efad514542c747c4a5b5deef38b447a8, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.163975 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.177729 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1384/2787] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:41 2022] PUT /identity/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c/users/efad514542c747c4a5b5deef38b447a8/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:17:41.181744 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.192110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3463b0fd-9b59-4eec-bdd5-a3f100bf504d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.216248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:41.256786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.257440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.257753 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.258032 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.258671 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.260282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a199cd-75d7-4953-b693-fdaa252b5116 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.270639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1404/2788] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:17:41 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:17:41.274790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:41.284824 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97678920-b6a0-4ebd-844e-c24984882477 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:41.289400 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:41.290039 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:41.290312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:41.290582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] PATH_INFO: `/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c/users/efad514542c747c4a5b5deef38b447a8/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:41.292466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a957d8ca0d2f40e086eefbcb7f0e3a9c, user_id=efad514542c747c4a5b5deef38b447a8, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:41.295099 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:41.304972 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1385/2789] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:17:41 2022] PUT /identity/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c/users/efad514542c747c4a5b5deef38b447a8/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:17:45.526405 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c16-4074-4f67-8efb-8f09d8079009 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.526897 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c16-4074-4f67-8efb-8f09d8079009 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.527130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b949c16-4074-4f67-8efb-8f09d8079009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.556594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3b949c16-4074-4f67-8efb-8f09d8079009 None None] MFA Rules not processed for user `efad514542c747c4a5b5deef38b447a8`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:45.557751 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b949c16-4074-4f67-8efb-8f09d8079009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:45.653859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1405/2790] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:45 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:45.664477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:17:45.666443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:45.750198 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0576ce-9f27-4e14-ac86-e8989089cf14 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:17:45.757650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:17:45.757650 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:45.757974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:45.758082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:45.851049 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:17:45.852689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:17:45.868147 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1386/2791] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:17:45 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:17:46.918519 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:17:46.920033 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:17:46.920658 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:17:46.942016 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] MFA Rules not processed for user `1c60b3d40f3f45c2bb3bc283e11ec805`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:17:46.943242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:17:46.950861 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1406/2792] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:17:46 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:17:55.858823 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:17:56.935710 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=56 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:07.162791 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:07.164219 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:07.309892 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d88057-eb81-45e8-962c-536fb82d71b2 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:07.315037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:07.315640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:07.315919 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:07.316194 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:07.318544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:07.329708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:07.331304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:07.341374 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1387/2793] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:07 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:10.428008 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:10.429487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:10.497788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c81d29-2776-4a16-b48d-4105e2beaf73 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:10.501577 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:10.502183 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:10.502464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:10.502739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:10.512041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:10.513490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:10.523191 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1407/2794] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:10 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:12.321956 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:12.323542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:12.370031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f7ea5f-2161-4a79-a275-5833d22456e6 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:12.375688 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:12.376398 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:12.376683 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:12.376959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:12.378733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:12.391456 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:12.393027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:12.404957 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1388/2795] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:12 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:20.518524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=32 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:22.400252 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.008860 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.020651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056feaad-0964-4aab-b381-c38e036b232f service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.025727 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.026428 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.026773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.027114 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.028906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.041318 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.043099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.053667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1408/2796] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:30.063110 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.064717 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.171075 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99dce8eb-89e9-4624-81b6-a939f5404f1c service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.175535 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.176170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.176445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.176714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] PATH_INFO: `/v3/users/80f428660fa3422ca82645b53c7ea2dc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.177851 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] RBAC: Authorizing `identity:delete_user(user_id=80f428660fa3422ca82645b53c7ea2dc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.179725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.224911 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80f428660fa3422ca82645b53c7ea2dc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.231454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80f428660fa3422ca82645b53c7ea2dc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.243138 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80f428660fa3422ca82645b53c7ea2dc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.243843 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80f428660fa3422ca82645b53c7ea2dc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.251035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a3890bce-c95e-403c-a556-ee43cafb2a0a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80f428660fa3422ca82645b53c7ea2dc'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.257756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1389/2797] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:30 2022] DELETE /identity/v3/users/80f428660fa3422ca82645b53c7ea2dc => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:30.438296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.449062 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d670e32-305f-4fba-87d4-3427662afda9 service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.506130 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.506685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.506964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.507236 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] PATH_INFO: `/v3/projects/cdd618eb561c486f954be396d6218b3e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.508342 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdd618eb561c486f954be396d6218b3e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.510281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.558839 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdd618eb561c486f954be396d6218b3e', 'request_id': 'req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.565579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdd618eb561c486f954be396d6218b3e', 'request_id': 'req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.571224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdd618eb561c486f954be396d6218b3e', 'request_id': 'req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.583305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] The token cache is being invalidate because project cdd618eb561c486f954be396d6218b3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:30.583600 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.584225 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1b99e3bf-d8ab-4f22-98ba-ee6793b2bc0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:30.585743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1409/2798] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:30 2022] DELETE /identity/v3/projects/cdd618eb561c486f954be396d6218b3e => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:30.590699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.591011 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.591296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.648966 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:30.650271 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.663356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:30.710670 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1390/2799] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:30.718298 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.718588 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.718864 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.738045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:30.739349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:30.747198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1410/2800] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:30.751302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.761755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0613df04-fb1a-4962-ad73-9af8aca52c8a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.766212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.766802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.767080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.767357 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.768009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:30.768346 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.770796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.782156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1391/2801] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:30.786425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.795547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482c4ae1-6652-4104-830b-7daf3b239f01 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.800198 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.800906 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.801351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.801631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.802258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.804143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.834846 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1411/2802] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:30 2022] POST /identity/v3/projects => generated 365 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:30.835934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.846001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333c3852-afff-4a67-ac99-e7bc7d0db2de admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.901837 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.902437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.902714 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.902989 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.903647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.905608 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.926303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1392/2803] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:30 2022] POST /identity/v3/users => generated 283 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:18:30.930241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.940487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b116a24b-e1a7-4790-9e56-a4eeeff12e5f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.945859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.946463 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.946743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.947015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.947661 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.949527 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.960554 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1412/2804] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:30.964420 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:30.974754 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a161a009-692f-4647-b99d-1e19c062f1ac admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:30.979315 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:30.979908 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:30.980188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:30.980459 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:30.981096 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:30.982699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd3de30-4f95-45d6-96d6-f85ffee17bbf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:30.993377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1393/2805] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:30.997292 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.007767 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e1422a-3999-4adb-a244-280e4f57b32a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.012414 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.013002 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.013308 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.013612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] PATH_INFO: `/v3/projects/9285b4585fc149259de2cd8f7dbe2329/users/b0357463d59e456f8434ecbfb281b06d/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.028789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9285b4585fc149259de2cd8f7dbe2329, user_id=b0357463d59e456f8434ecbfb281b06d, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.031514 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.044301 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1413/2806] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:30 2022] PUT /identity/v3/projects/9285b4585fc149259de2cd8f7dbe2329/users/b0357463d59e456f8434ecbfb281b06d/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:31.055253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.055572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.055809 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.083839 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] MFA Rules not processed for user `b0357463d59e456f8434ecbfb281b06d`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:31.085030 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:31.148052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1394/2807] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:31 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:31.152651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.166022 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.214439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a1b345-74bc-46a9-bfd8-d5241589d7b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.219004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.219603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.219878 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.221623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.221623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.222682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.248923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1414/2808] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:31 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:31.253072 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.264544 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89f61ef-30db-45e9-a632-8d130315b3c3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.275722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.320760 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.321388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.321674 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.321945 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.322559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.324448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.344958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1395/2809] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:31 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:31.349044 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.359161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa8697-e341-4ff4-a1ae-501d906fe6de admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.365321 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.365930 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.366188 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.366457 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.367086 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.368662 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.379512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1415/2810] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:31.383854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.393811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701c54f8-3638-4b3c-9e4e-b52e8a577b9a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.398560 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.399206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.399555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.399765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] PATH_INFO: `/v3/projects/2fdee94a86314a7f87866a55c882884d/users/3d0b1199fd9b4d7695f55dc30d0f7570/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.414980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdee94a86314a7f87866a55c882884d, user_id=3d0b1199fd9b4d7695f55dc30d0f7570, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.417643 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.430538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1396/2811] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:31 2022] PUT /identity/v3/projects/2fdee94a86314a7f87866a55c882884d/users/3d0b1199fd9b4d7695f55dc30d0f7570/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:31.434472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.444440 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b127200-0828-4388-870c-05deb39b420d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.501285 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.501886 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.502164 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.502449 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.503066 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.504731 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af26f5b1-b04b-45a2-8236-0efb38d5fd2d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.514840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1416/2812] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:31.518895 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.529293 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00736380-a768-484c-92e3-6108aa147b28 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.533880 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.534528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.534805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.535589 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] PATH_INFO: `/v3/projects/2fdee94a86314a7f87866a55c882884d/users/3d0b1199fd9b4d7695f55dc30d0f7570/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.537658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fdee94a86314a7f87866a55c882884d, user_id=3d0b1199fd9b4d7695f55dc30d0f7570, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.540276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.550458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1397/2813] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:31 2022] PUT /identity/v3/projects/2fdee94a86314a7f87866a55c882884d/users/3d0b1199fd9b4d7695f55dc30d0f7570/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:31.562453 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.562736 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.563005 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.591763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] MFA Rules not processed for user `3d0b1199fd9b4d7695f55dc30d0f7570`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:31.592959 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:31.658068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1417/2814] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:31.669052 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.670739 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:31.746190 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680f69ad-215f-4349-bf35-6df234153391 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.749755 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.750343 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.750619 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.750888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.760248 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.761693 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.771915 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1398/2815] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:31.844486 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:31.854305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf25369-24ad-497e-823f-d8d5a0b3c592 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:31.857879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:31.858467 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:31.858746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:31.859024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:31.865055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:31.919962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:31.921533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babe2ba7-9790-4317-b83b-c19e03cb78f0 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:31.933048 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1418/2816] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:37.830600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:37.880074 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:37.892927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edc198-3075-4f5c-9f89-dfd91140c1a8 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:37.898195 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:37.898819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:37.899112 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:37.899390 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] PATH_INFO: `/v3/users/b0357463d59e456f8434ecbfb281b06d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:37.900521 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0357463d59e456f8434ecbfb281b06d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:37.902470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:37.961988 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0357463d59e456f8434ecbfb281b06d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:37.969338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0357463d59e456f8434ecbfb281b06d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:37.980958 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0357463d59e456f8434ecbfb281b06d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:37.981658 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0357463d59e456f8434ecbfb281b06d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:37.989044 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0357463d59e456f8434ecbfb281b06d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:37.995118 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1399/2817] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:37 2022] DELETE /identity/v3/users/b0357463d59e456f8434ecbfb281b06d => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:37.999594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.000122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.000122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.019420 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:38.020592 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:38.077602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1419/2818] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:38.088466 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.089978 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:38.168995 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fb5f9-1096-4256-98e9-ca3d7ef951a6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.172680 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.173323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.173632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.173884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.183439 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.184847 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.194708 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1400/2819] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:38.464435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.466035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:38.478823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f63f8a-c560-46a6-81ab-ea793dc56066 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.483461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.484095 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.484371 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.484642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] PATH_INFO: `/v3/projects/9285b4585fc149259de2cd8f7dbe2329` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.485809 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9285b4585fc149259de2cd8f7dbe2329)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.487754 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.537616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9285b4585fc149259de2cd8f7dbe2329', 'request_id': 'req-675d1b83-ee37-4d85-a53c-81de15a97a73'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.544629 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9285b4585fc149259de2cd8f7dbe2329', 'request_id': 'req-675d1b83-ee37-4d85-a53c-81de15a97a73'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.550258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9285b4585fc149259de2cd8f7dbe2329', 'request_id': 'req-675d1b83-ee37-4d85-a53c-81de15a97a73'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.561870 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] The token cache is being invalidate because project 9285b4585fc149259de2cd8f7dbe2329 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:38.562160 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.562788 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.564281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1420/2820] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:38 2022] DELETE /identity/v3/projects/9285b4585fc149259de2cd8f7dbe2329 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:38.568197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.577921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a84112-0178-423c-b102-5fe488039f0c service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:38.628676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:38.639119 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:38.640006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:38.640275 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:38.640555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] PATH_INFO: `/v3/users/3d0b1199fd9b4d7695f55dc30d0f7570` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:38.641746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d0b1199fd9b4d7695f55dc30d0f7570)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:38.643644 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:38.691301 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d0b1199fd9b4d7695f55dc30d0f7570'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.698154 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d0b1199fd9b4d7695f55dc30d0f7570'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.710012 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d0b1199fd9b4d7695f55dc30d0f7570'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.710733 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d0b1199fd9b4d7695f55dc30d0f7570'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.717846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-72351ab0-ce89-42df-b1d3-ba6a95615f45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d0b1199fd9b4d7695f55dc30d0f7570'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:38.723641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1401/2821] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:38 2022] DELETE /identity/v3/users/3d0b1199fd9b4d7695f55dc30d0f7570 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:38.991406 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:38.992926 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:39.005972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675d1b83-ee37-4d85-a53c-81de15a97a73 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.034936 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.063711 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.064337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.064610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.064880 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] PATH_INFO: `/v3/projects/2fdee94a86314a7f87866a55c882884d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.066024 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fdee94a86314a7f87866a55c882884d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.067935 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.114311 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fdee94a86314a7f87866a55c882884d', 'request_id': 'req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:39.121535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fdee94a86314a7f87866a55c882884d', 'request_id': 'req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:39.127144 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fdee94a86314a7f87866a55c882884d', 'request_id': 'req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:39.137837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] The token cache is being invalidate because project 2fdee94a86314a7f87866a55c882884d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:39.138123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:39.138743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-91d9a0e6-94b2-4212-bb0a-9d5301ce0174 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:39.140243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1421/2822] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:38 2022] DELETE /identity/v3/projects/2fdee94a86314a7f87866a55c882884d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:39.145304 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.145789 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.145891 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.166804 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:39.168117 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:39.231325 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1402/2823] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:39.239340 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.239561 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.239916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.260020 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:39.261229 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:39.269224 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1422/2824] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:39.274302 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.284009 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee810f-121c-4533-a4c2-4ca92266a7b5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.288652 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.289276 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.289559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.289838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.290490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:39.290797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.292382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.304352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1403/2825] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:39.308490 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.317542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e30c31b-ff96-4a09-ba38-54334204fb8c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.322740 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.323327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.323623 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.323892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.324508 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.326409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.353499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1423/2826] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:39.357682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.368308 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de94570e-42ad-49ba-a475-f39a76aec232 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.425481 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.426082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.426362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.426641 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.427757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.429677 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.437515 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.452697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1404/2827] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/users => generated 291 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:39.457360 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.467922 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c5d33c-ecd2-412b-b9a2-4b7ea1d0d6a2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.472768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.473409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.473690 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.473960 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.474817 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.476522 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.486381 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1424/2828] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:39.490980 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.500697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8d62d8-110f-4313-818b-8a9d224927ff admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.505237 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.506413 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.506691 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.506964 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.507595 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.509168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd19cfa2-8ec1-4fc7-878d-55452cdc6c5a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.519472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1405/2829] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:39.523481 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.533718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849fd06d-10f8-4bd3-990b-a0bcd392964e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.538738 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.539793 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.540284 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.540773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] PATH_INFO: `/v3/projects/3ea4c02c76a347788a85812bd49c8f23/users/e9e43133ad614158b71861489f05d2cc/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.558667 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3ea4c02c76a347788a85812bd49c8f23, user_id=e9e43133ad614158b71861489f05d2cc, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.561427 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.574772 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1425/2830] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:39 2022] PUT /identity/v3/projects/3ea4c02c76a347788a85812bd49c8f23/users/e9e43133ad614158b71861489f05d2cc/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:39.585601 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.585884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.586172 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.612776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] MFA Rules not processed for user `e9e43133ad614158b71861489f05d2cc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:39.614000 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:39.676949 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1406/2831] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:39.681965 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.740135 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:39.744563 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c8636-f77e-442e-8737-9c969cf5e475 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.750170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.750984 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.751445 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.751774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.752612 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.754616 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.780689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1426/2832] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:39.784747 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.795936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff16684-734f-4193-85cc-095cadf79b8f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.851941 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.852543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.852820 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.853095 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.853825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.855724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.879159 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1407/2833] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:39 2022] POST /identity/v3/users => generated 296 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:39.883273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.893389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea27476-9b89-40ec-b42c-5927fcad5ded admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.898011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.898601 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.898876 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.899143 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.899774 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.901394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.911559 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1427/2834] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:39.916369 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.926296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f5bd33-1281-4d8d-9e53-700418763c19 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:39.931662 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:39.932306 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:39.932582 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:39.932853 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] PATH_INFO: `/v3/projects/ca26ad7586f1401780b05918cf93919f/users/fee0043e89af44279d345dd0cdeed66d/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:39.948732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca26ad7586f1401780b05918cf93919f, user_id=fee0043e89af44279d345dd0cdeed66d, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:39.951437 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:39.964607 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1408/2835] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:39 2022] PUT /identity/v3/projects/ca26ad7586f1401780b05918cf93919f/users/fee0043e89af44279d345dd0cdeed66d/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:39.969743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:39.980479 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ec6a30-0e50-41bd-9cf6-4e716af73dc0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.035289 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.035923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.036068 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.036334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.037603 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.039205 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625aac20-8940-411a-85fa-3fff1ce54d88 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.049536 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1428/2836] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:39 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:40.053811 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.064546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d18035-faf8-4f8b-b0eb-95aca6bfebdf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.069817 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.070477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.070757 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.071032 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] PATH_INFO: `/v3/projects/ca26ad7586f1401780b05918cf93919f/users/fee0043e89af44279d345dd0cdeed66d/roles/735711bc5949482f97472a303cdeab41` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.073018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ca26ad7586f1401780b05918cf93919f, user_id=fee0043e89af44279d345dd0cdeed66d, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.075678 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.087056 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1409/2837] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:40 2022] PUT /identity/v3/projects/ca26ad7586f1401780b05918cf93919f/users/fee0043e89af44279d345dd0cdeed66d/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:40.103670 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.103954 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.104232 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.135928 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] MFA Rules not processed for user `fee0043e89af44279d345dd0cdeed66d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:40.137156 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:40.213709 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1429/2838] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:40 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:40.231133 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.233061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:40.256974 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.310951 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249dc0bf-e49c-4e9a-b8fd-413a9ae5c8b3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.314596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.315205 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.315478 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.315746 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.326625 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.328730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.346622 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1410/2839] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:40.694404 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.704319 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b06f3e9-3bbf-46cd-9bbb-e071d651586a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.710248 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee0043e89af44279d345dd0cdeed66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca26ad7586f1401780b05918cf93919f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.711431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.711431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.711431 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.712051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.712358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.714293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.727282 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1430/2840] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.731523 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.740742 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610eb855-fbac-4222-9f23-092e7b8f545f service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.745665 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee0043e89af44279d345dd0cdeed66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca26ad7586f1401780b05918cf93919f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.745888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.747328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.747328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.747328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.749736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.779562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1411/2841] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:40 2022] POST /identity/v3/projects => generated 355 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:40.784988 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.794056 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eec233-492a-4052-9978-cd6ec252b1e2 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.840335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:40.860523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee0043e89af44279d345dd0cdeed66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca26ad7586f1401780b05918cf93919f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.861128 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.861642 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.861920 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.862566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:40.862875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.864465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.880273 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1431/2842] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:40.916922 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:40.926959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de3cd99-c1cb-4d21-b894-d4c788695e39 tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:40.932041 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fee0043e89af44279d345dd0cdeed66d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ca26ad7586f1401780b05918cf93919f', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:40.932659 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:40.932936 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:40.933231 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] PATH_INFO: `/v3/projects/55cbefbc550d48d289bacf9fa1f48f2d` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:40.934366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorizing `identity:delete_project(project_id=55cbefbc550d48d289bacf9fa1f48f2d)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:40.936249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:40.983186 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55cbefbc550d48d289bacf9fa1f48f2d', 'request_id': 'req-2cc9264f-295b-40b1-9f35-c8462c3d2acd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:40.989676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55cbefbc550d48d289bacf9fa1f48f2d', 'request_id': 'req-2cc9264f-295b-40b1-9f35-c8462c3d2acd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:40.995776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55cbefbc550d48d289bacf9fa1f48f2d', 'request_id': 'req-2cc9264f-295b-40b1-9f35-c8462c3d2acd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.008108 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] The token cache is being invalidate because project 55cbefbc550d48d289bacf9fa1f48f2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:41.008396 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.009029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2cc9264f-295b-40b1-9f35-c8462c3d2acd tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.010546 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1412/2843] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:40 2022] DELETE /identity/v3/projects/55cbefbc550d48d289bacf9fa1f48f2d => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:41.207678 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.209520 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:41.274702 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494891f4-8e32-4ef7-82c6-f0b1421c65ee tempest-VolumeQuotaClassesTest-456311883 tempest-VolumeQuotaClassesTest-456311883-project-admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.328748 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.329399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.329677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.329964 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] PATH_INFO: `/v3/users/e9e43133ad614158b71861489f05d2cc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.331325 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9e43133ad614158b71861489f05d2cc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.333252 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.376962 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9e43133ad614158b71861489f05d2cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.383757 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9e43133ad614158b71861489f05d2cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.390868 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9e43133ad614158b71861489f05d2cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.391492 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9e43133ad614158b71861489f05d2cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.403613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9e43133ad614158b71861489f05d2cc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.405835 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.410547 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1432/2844] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:41 2022] DELETE /identity/v3/users/e9e43133ad614158b71861489f05d2cc => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:41.415646 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.416139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.416253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.435385 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:41.436578 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:41.494491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1413/2845] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:41.504127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.505584 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:41.561438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de801b-c7a9-47c3-a65d-8a83506685c6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.565051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.565677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.565958 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.566227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.575080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.576525 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.586489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1433/2846] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:41.843865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.845366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:41.862037 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ac7fda-343d-48a3-aeb1-ac5c84c7565d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:41.867197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:41.867977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:41.868367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:41.868524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] PATH_INFO: `/v3/projects/3ea4c02c76a347788a85812bd49c8f23` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:41.869704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=3ea4c02c76a347788a85812bd49c8f23)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:41.871764 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:41.894474 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:41.921204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3ea4c02c76a347788a85812bd49c8f23', 'request_id': 'req-e917d66b-b613-4b14-a67c-46c666b1e5dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.927916 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3ea4c02c76a347788a85812bd49c8f23', 'request_id': 'req-e917d66b-b613-4b14-a67c-46c666b1e5dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.933403 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3ea4c02c76a347788a85812bd49c8f23', 'request_id': 'req-e917d66b-b613-4b14-a67c-46c666b1e5dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.946362 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] The token cache is being invalidate because project 3ea4c02c76a347788a85812bd49c8f23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:41.946782 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.947517 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:41.948979 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1414/2847] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:41 2022] DELETE /identity/v3/projects/3ea4c02c76a347788a85812bd49c8f23 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:41.952985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:41.963485 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd31aee-fe77-445c-a8ad-043f8e5dd779 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.018438 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.018986 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.019262 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.019535 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] PATH_INFO: `/v3/users/fee0043e89af44279d345dd0cdeed66d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.020640 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee0043e89af44279d345dd0cdeed66d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.023227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.069027 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee0043e89af44279d345dd0cdeed66d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.075914 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee0043e89af44279d345dd0cdeed66d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.083092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee0043e89af44279d345dd0cdeed66d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.084380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee0043e89af44279d345dd0cdeed66d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.097295 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-59274a16-97ae-4d73-a863-d6e0f1a95671 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee0043e89af44279d345dd0cdeed66d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.103035 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1434/2848] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:41 2022] DELETE /identity/v3/users/fee0043e89af44279d345dd0cdeed66d => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:42.376661 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.378251 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:42.392505 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e917d66b-b613-4b14-a67c-46c666b1e5dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.450873 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.451552 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.451761 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.452040 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] PATH_INFO: `/v3/projects/ca26ad7586f1401780b05918cf93919f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.453128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=ca26ad7586f1401780b05918cf93919f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.455034 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.499092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ca26ad7586f1401780b05918cf93919f', 'request_id': 'req-96845d69-1346-4bcc-8b15-30e3aefd78ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.504932 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ca26ad7586f1401780b05918cf93919f', 'request_id': 'req-96845d69-1346-4bcc-8b15-30e3aefd78ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.510897 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ca26ad7586f1401780b05918cf93919f', 'request_id': 'req-96845d69-1346-4bcc-8b15-30e3aefd78ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.522699 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] The token cache is being invalidate because project ca26ad7586f1401780b05918cf93919f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:42.522984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.523593 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-96845d69-1346-4bcc-8b15-30e3aefd78ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:42.525035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1415/2849] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:42 2022] DELETE /identity/v3/projects/ca26ad7586f1401780b05918cf93919f => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:42.530052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.530529 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.530649 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.550132 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:42.551241 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:42.569407 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:42.613014 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1435/2850] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:42.621556 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.621842 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.622115 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.642342 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:42.643543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:42.651351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1416/2851] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:18:42.655401 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.665618 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff11ce-e0e3-495d-9da2-0028d26504d7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.670127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.670721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.670994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.671259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.671894 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:42.672200 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.673824 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.685746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1436/2852] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:42.689969 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.699322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376a43a7-9c72-40f9-84b0-4195fe837280 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.703899 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.704480 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.704751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.705023 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.705931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.707778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.734822 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1417/2853] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/projects => generated 367 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:42.738925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.749357 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa8d3b7-d2fd-4c73-9a34-917a73172985 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.804544 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.805076 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.805389 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.805664 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.806281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.808185 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.829031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1437/2854] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:42.833570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.844005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40baa894-24e3-4b73-a05c-93b9daa2eb5f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.848854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.850016 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.850292 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.850559 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.851192 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.852796 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.854790 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:42.863705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1418/2855] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:42.867859 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.878083 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4c1a77-c231-4fd3-9eae-95e50f1d7f78 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.884470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.885058 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.885365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.885639 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.886271 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.887840 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06551e1b-d658-4c55-8500-a585da0a3e2c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.898305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1438/2856] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:42.902332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:42.912858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caf8bc9-0614-4e60-97de-d4d6c071f04a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:42.917428 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:42.918097 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.918376 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.918653 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] PATH_INFO: `/v3/projects/d6df5ed8155d48fc8e6934ad93baa25e/users/70aeb09dc530477583fe2e9b83a7a479/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.935921 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6df5ed8155d48fc8e6934ad93baa25e, user_id=70aeb09dc530477583fe2e9b83a7a479, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:42.938621 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:42.951111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1419/2857] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:42 2022] PUT /identity/v3/projects/d6df5ed8155d48fc8e6934ad93baa25e/users/70aeb09dc530477583fe2e9b83a7a479/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:42.962896 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:42.963180 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:42.963456 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:42.993689 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] MFA Rules not processed for user `70aeb09dc530477583fe2e9b83a7a479`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:42.994901 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:43.058971 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1439/2858] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:43.063565 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.125697 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2975fe11-eb83-475a-a802-f30b407be3f7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.130338 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.131024 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.131305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.131583 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.132206 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.134148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.159865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1420/2859] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:43 2022] POST /identity/v3/projects => generated 365 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:43.164760 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.175433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea755a1-4c7f-4485-8ad3-f00c796dc065 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.187329 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:43.232260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.232862 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.233264 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.233545 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.234159 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.236074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.257117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1440/2860] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:43 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 01 05:18:43.261126 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.271831 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367f8792-11d4-44be-b103-0a3b4bea6064 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.276586 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.277214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.277504 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.277785 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.278435 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.280028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.291283 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1421/2861] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:43.295275 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.305425 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91171058-166e-4842-9f67-36035733bcf5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.310011 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.310596 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.310873 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.311145 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] PATH_INFO: `/v3/projects/351c282e34664e589e78f95af6fd2f75/users/c161e8e177bc4cd386aa8db405a012fa/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.325258 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351c282e34664e589e78f95af6fd2f75, user_id=c161e8e177bc4cd386aa8db405a012fa, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.327882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.342150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1441/2862] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:43 2022] PUT /identity/v3/projects/351c282e34664e589e78f95af6fd2f75/users/c161e8e177bc4cd386aa8db405a012fa/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:43.346128 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.356605 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc502a2-c79b-42c9-9427-f6cead3694ed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.413307 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.413903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.414182 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.414454 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.415084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.416687 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-668cc4cf-ca86-48a0-9048-82fc507e6bcf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.426130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1422/2863] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:43.430421 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.440558 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0132a3-8dd9-44fb-89ef-3325a44428e8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.445877 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.446524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.446802 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.447077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] PATH_INFO: `/v3/projects/351c282e34664e589e78f95af6fd2f75/users/c161e8e177bc4cd386aa8db405a012fa/roles/735711bc5949482f97472a303cdeab41` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.448989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=351c282e34664e589e78f95af6fd2f75, user_id=c161e8e177bc4cd386aa8db405a012fa, role_id=735711bc5949482f97472a303cdeab41)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.451653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.462504 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1442/2864] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:43 2022] PUT /identity/v3/projects/351c282e34664e589e78f95af6fd2f75/users/c161e8e177bc4cd386aa8db405a012fa/roles/735711bc5949482f97472a303cdeab41 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:43.523555 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318140a1-266f-48fb-8bee-485fad136805 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.524163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318140a1-266f-48fb-8bee-485fad136805 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.524163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-318140a1-266f-48fb-8bee-485fad136805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.551640 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-318140a1-266f-48fb-8bee-485fad136805 None None] MFA Rules not processed for user `c161e8e177bc4cd386aa8db405a012fa`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:43.552934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-318140a1-266f-48fb-8bee-485fad136805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:43.586168 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:43.621726 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1423/2865] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:43 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:18:43.633534 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.635539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:43.691804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308a1893-314c-49aa-bab1-5896f8387b34 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.696107 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.696695 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.696967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.697260 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.706395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.707828 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.717921 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1443/2866] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:43.799116 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318140a1-266f-48fb-8bee-485fad136805 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:43.809262 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-318140a1-266f-48fb-8bee-485fad136805 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:43.812762 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:43.813386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:43.813663 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:43.813931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:43.870365 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:43.871810 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e188916-7077-43e9-8344-7ac362fd34dd service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:43.881597 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1424/2867] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:43 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:48.567335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.627676 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d697771-20aa-4734-8aa8-ed9cd19d93d9 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.633075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.633723 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.634004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.634277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] PATH_INFO: `/v3/users/70aeb09dc530477583fe2e9b83a7a479` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.635395 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] RBAC: Authorizing `identity:delete_user(user_id=70aeb09dc530477583fe2e9b83a7a479)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.637334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.651931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:48.683070 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70aeb09dc530477583fe2e9b83a7a479'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:48.689716 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70aeb09dc530477583fe2e9b83a7a479'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:48.697051 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70aeb09dc530477583fe2e9b83a7a479'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:48.697773 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70aeb09dc530477583fe2e9b83a7a479'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:48.710317 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70aeb09dc530477583fe2e9b83a7a479'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:48.716075 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1444/2868] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:48 2022] DELETE /identity/v3/users/70aeb09dc530477583fe2e9b83a7a479 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:48.720600 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.721083 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.721253 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.740527 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:48.741918 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:48.798568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1425/2869] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:48.808911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:48.810334 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:48.867747 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a660361b-0be4-4f3b-af19-102fd5d3188e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:48.871549 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:48.872158 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:48.872435 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:48.872705 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:48.881651 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:48.883169 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:48.892496 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1445/2870] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:18:49.158599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.160035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:49.172610 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946ab8cc-db7d-492c-a029-9d2fd3689a85 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.177568 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.178352 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.178599 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.178870 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] PATH_INFO: `/v3/projects/d6df5ed8155d48fc8e6934ad93baa25e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.180850 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6df5ed8155d48fc8e6934ad93baa25e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.183004 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.229069 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6df5ed8155d48fc8e6934ad93baa25e', 'request_id': 'req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.235007 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6df5ed8155d48fc8e6934ad93baa25e', 'request_id': 'req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.240332 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6df5ed8155d48fc8e6934ad93baa25e', 'request_id': 'req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.242134 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.253477 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] The token cache is being invalidate because project d6df5ed8155d48fc8e6934ad93baa25e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:49.253787 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.254446 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.255909 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1426/2871] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:49 2022] DELETE /identity/v3/projects/d6df5ed8155d48fc8e6934ad93baa25e => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:49.260012 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.269511 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbebce1-561a-4a2f-b77a-39f715696d67 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.324552 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.325170 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.325470 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.325739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] PATH_INFO: `/v3/users/c161e8e177bc4cd386aa8db405a012fa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.326837 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c161e8e177bc4cd386aa8db405a012fa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.328739 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.365923 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:49.375108 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c161e8e177bc4cd386aa8db405a012fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.382512 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c161e8e177bc4cd386aa8db405a012fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.389489 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c161e8e177bc4cd386aa8db405a012fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.390097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c161e8e177bc4cd386aa8db405a012fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.402941 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2872f7de-4573-44e6-b2f7-fb351e59375f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c161e8e177bc4cd386aa8db405a012fa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.409677 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1446/2872] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:18:49 2022] DELETE /identity/v3/users/c161e8e177bc4cd386aa8db405a012fa => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:49.677903 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.679587 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:49.693045 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbcb0a6-97dd-4724-bfc6-3c4c75796cf6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.750863 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.751575 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.751744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.752015 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] PATH_INFO: `/v3/projects/351c282e34664e589e78f95af6fd2f75` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.753107 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=351c282e34664e589e78f95af6fd2f75)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.755063 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.799038 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '351c282e34664e589e78f95af6fd2f75', 'request_id': 'req-fa194a10-3221-4d4b-804f-41697f1fcbff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.805447 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '351c282e34664e589e78f95af6fd2f75', 'request_id': 'req-fa194a10-3221-4d4b-804f-41697f1fcbff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.810777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '351c282e34664e589e78f95af6fd2f75', 'request_id': 'req-fa194a10-3221-4d4b-804f-41697f1fcbff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.823079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] The token cache is being invalidate because project 351c282e34664e589e78f95af6fd2f75 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:18:49.823363 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.823977 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fa194a10-3221-4d4b-804f-41697f1fcbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:18:49.825460 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1427/2873] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:18:49 2022] DELETE /identity/v3/projects/351c282e34664e589e78f95af6fd2f75 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:18:49.830663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.831162 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.831266 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.850433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:49.851675 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:49.909100 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1447/2874] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:49.917079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.917383 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.917657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.938799 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:49.939992 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:49.948686 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1428/2875] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:49.953042 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.963003 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d047-0a16-41b7-aced-bff3b90f4339 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:49.967539 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:49.968116 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:49.968392 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:49.968663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:49.969327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:18:49.969628 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:49.971207 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:49.982622 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1448/2876] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:18:49.987051 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:49.996808 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5087b77f-516c-4e7b-9678-a8fc55e448b9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.001462 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.002101 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.002350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.002604 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.003225 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.005084 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.031832 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1429/2877] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:18:49 2022] POST /identity/v3/projects => generated 377 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:50.035910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.046193 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1f652-52a4-404a-a8a2-42b290b4e7fd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.103510 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.104115 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.104399 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.104672 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.105335 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.107243 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.128373 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1449/2878] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:18:50 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:18:50.132689 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.143006 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d60e12-2443-4457-aacf-04567cf1b7bc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.147848 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.148443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.148723 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.149005 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.149682 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.151264 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.161021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1430/2879] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:50.165442 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.175265 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3479f-e3f6-42b5-be1e-8e10b021a245 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.180533 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.181117 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.181424 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.181696 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.182331 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.183912 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e590b2-c51b-4b9b-b8ad-e454876c0799 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.194602 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1450/2880] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:18:50.198508 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.208730 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c16f3d5-8474-4d63-aa0d-cb6447a94f7d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.213455 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.214104 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.214387 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.214666 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] PATH_INFO: `/v3/projects/9fa16905219841a9a1301bd6b769684f/users/f98e45def7124bec8303d9ee64ad1b65/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.229445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9fa16905219841a9a1301bd6b769684f, user_id=f98e45def7124bec8303d9ee64ad1b65, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.232078 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.245967 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1431/2881] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:18:50 2022] PUT /identity/v3/projects/9fa16905219841a9a1301bd6b769684f/users/f98e45def7124bec8303d9ee64ad1b65/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:18:50.257644 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.257863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.258136 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.285351 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] MFA Rules not processed for user `f98e45def7124bec8303d9ee64ad1b65`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:18:50.286543 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:50.295127 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.353413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1451/2882] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:18:50 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:18:50.364310 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:18:50.366854 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:18:50.386626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:18:50.425711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ec688e-6b8a-44d6-bb58-285dd41ce31a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:18:50.430001 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b1e3deabee4f46cb9e0c15f94e5ab23d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:18:50.430606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:18:50.430888 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:18:50.431170 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:18:50.439294 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:18:50.440705 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32463d4-9b83-4bf7-a98f-fd24a0f942b9 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:18:50.449609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1432/2883] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:18:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:00.349787 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=23 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:00.445998 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=18 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:03.827875 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:03.891491 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbef7c3f-9fc5-41e6-a077-a4488412224a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:03.896006 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:03.896633 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.896916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.897204 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] PATH_INFO: `/v3/users/f98e45def7124bec8303d9ee64ad1b65` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:03.898336 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f98e45def7124bec8303d9ee64ad1b65)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:03.900256 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:03.944949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f98e45def7124bec8303d9ee64ad1b65'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:03.952621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f98e45def7124bec8303d9ee64ad1b65'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:03.960823 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f98e45def7124bec8303d9ee64ad1b65'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:03.961569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f98e45def7124bec8303d9ee64ad1b65'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:03.976841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f98e45def7124bec8303d9ee64ad1b65'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:03.982863 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1452/2884] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:19:03 2022] DELETE /identity/v3/users/f98e45def7124bec8303d9ee64ad1b65 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:03.987469 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:03.987947 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:03.988048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.007557 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:04.008741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.066229 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1433/2885] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:04.076643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.078074 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.135208 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a001821-85cb-4e2a-939b-292be3a72bdb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.139409 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.140004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.140277 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.140542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.149685 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.151099 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c581e-7e1e-4d02-b4bd-d58722e00559 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.160472 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1453/2886] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:04.426647 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.428129 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.441029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8396c99-cd7e-4d9f-9c22-75472673de23 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.445725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.446354 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.446632 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.446905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] PATH_INFO: `/v3/projects/9fa16905219841a9a1301bd6b769684f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.448028 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9fa16905219841a9a1301bd6b769684f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.449996 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.497871 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9fa16905219841a9a1301bd6b769684f', 'request_id': 'req-774a5547-3ae8-4911-9dbf-e236c700c1c7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:04.503924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9fa16905219841a9a1301bd6b769684f', 'request_id': 'req-774a5547-3ae8-4911-9dbf-e236c700c1c7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:04.509490 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9fa16905219841a9a1301bd6b769684f', 'request_id': 'req-774a5547-3ae8-4911-9dbf-e236c700c1c7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:04.521092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] The token cache is being invalidate because project 9fa16905219841a9a1301bd6b769684f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:19:04.521406 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:04.522031 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-774a5547-3ae8-4911-9dbf-e236c700c1c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:19:04.523497 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1434/2887] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:19:04 2022] DELETE /identity/v3/projects/9fa16905219841a9a1301bd6b769684f => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:04.529594 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.529879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.530150 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.549947 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:04.551138 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.568369 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:04.612246 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1454/2888] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:04.620148 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.620430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.620704 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.640917 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:04.642149 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:04.649795 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1435/2889] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:04.654789 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.664219 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aace515-94a9-4f22-9766-aef36d6521af None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.669418 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.670007 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.670281 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.670550 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.671190 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 01 05:19:04.671488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.673055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.684142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1455/2890] 10.222.0.43 () {58 vars in 1153 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 01 05:19:04.688392 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.697445 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f1939b-9930-46ce-b00f-d599b95c0cf5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.702214 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.702807 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.703092 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.703366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.703987 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.706188 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.733900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1436/2891] 10.222.0.43 () {60 vars in 1153 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:04.738045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.754836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6f35-7ebc-4f93-8b3f-4ae547133d9b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.810858 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.811461 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.811742 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.812015 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.812683 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.814630 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.835887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1456/2892] 10.222.0.43 () {60 vars in 1144 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 01 05:19:04.840696 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.850937 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8bafd5-2fce-445f-95d0-335aece8584b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.855657 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.856139 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.856422 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.857395 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.858156 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.859866 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.875382 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1437/2893] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:19:04.877213 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.887341 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b55a0c-510d-4b9f-bc9d-169e8d3aebdd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.891892 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.892507 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.892782 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.893055 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.893745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.895316 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7d51e1-8127-4dfd-a5fc-0ce96adc1f04 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.906465 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1457/2894] 10.222.0.43 () {58 vars in 1122 bytes} [Thu Sep 1 05:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 01 05:19:04.910472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:04.920816 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5135c2-65e4-4127-adeb-ca0155ca2525 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:04.925377 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:04.926018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.926295 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.926570 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] PATH_INFO: `/v3/projects/7abd6d0e2d5e474ebdc74882b63447c5/users/998651e3aad144ab9a69e4e2ae45585a/roles/08fff9389c4141b080d31ea8280129d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.940860 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7abd6d0e2d5e474ebdc74882b63447c5, user_id=998651e3aad144ab9a69e4e2ae45585a, role_id=08fff9389c4141b080d31ea8280129d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:04.943765 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:04.957457 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1438/2895] 10.222.0.43 () {60 vars in 1483 bytes} [Thu Sep 1 05:19:04 2022] PUT /identity/v3/projects/7abd6d0e2d5e474ebdc74882b63447c5/users/998651e3aad144ab9a69e4e2ae45585a/roles/08fff9389c4141b080d31ea8280129d0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:19:04.962458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dab9b-f00f-4b51-8c2d-3939803bd996 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:04.962768 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dab9b-f00f-4b51-8c2d-3939803bd996 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:04.963040 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6dab9b-f00f-4b51-8c2d-3939803bd996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:04.982322 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1d6dab9b-f00f-4b51-8c2d-3939803bd996 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:04.983500 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d6dab9b-f00f-4b51-8c2d-3939803bd996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:05.040092 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1458/2896] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:05.049805 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:05.051470 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:05.072797 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.110405 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17297cae-406a-4e95-95b7-449e2ebfd02e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:05.114029 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:05.114626 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.114905 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.115178 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.124391 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:05.125907 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:05.135021 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1439/2897] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:05.737437 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234adad-8fdd-4d2b-bd54-a82c87e1e040 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.737721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234adad-8fdd-4d2b-bd54-a82c87e1e040 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.737994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234adad-8fdd-4d2b-bd54-a82c87e1e040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.766765 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6234adad-8fdd-4d2b-bd54-a82c87e1e040 None None] MFA Rules not processed for user `998651e3aad144ab9a69e4e2ae45585a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:05.767968 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6234adad-8fdd-4d2b-bd54-a82c87e1e040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:05.784631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:05.835910 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1459/2898] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:05 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:05.846802 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:05.848285 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:05.907777 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4be3ddd-4f56-47ac-b7f1-56f5a0b915d1 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:05.911356 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fec5602226564e6b95baf1ab9824ff0f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:05.911970 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:05.912249 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:05.912525 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:05.921732 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:05.923080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946fb5-2bcd-4ff1-8667-23d56d1a6dd2 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:05.931744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1440/2899] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:05 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:07.297981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:07.298524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:07.298524 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:07.318097 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] MFA Rules not processed for user `998651e3aad144ab9a69e4e2ae45585a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:07.319337 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:07.326413 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1460/2900] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:19:07 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:15.927798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=43 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:17.312352 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=22 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:19:31.133715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e79f-3126-4a7d-893c-2f71ba1bb835 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.134243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e79f-3126-4a7d-893c-2f71ba1bb835 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.134243 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8550e79f-3126-4a7d-893c-2f71ba1bb835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.153792 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8550e79f-3126-4a7d-893c-2f71ba1bb835 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:31.154984 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8550e79f-3126-4a7d-893c-2f71ba1bb835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:31.162815 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1441/2901] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:31.180263 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:31.181899 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:31.254179 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3991cd-a9e5-4a0f-a43d-8e106a9fa46c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:31.259721 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:31.260327 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:31.260610 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:31.260887 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:31.269203 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:31.270818 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:31.280072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1461/2902] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:34.205576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1992a5-6109-411e-b48c-70dabafc820e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.206175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1992a5-6109-411e-b48c-70dabafc820e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.206175 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1992a5-6109-411e-b48c-70dabafc820e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.226123 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7f1992a5-6109-411e-b48c-70dabafc820e None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:34.227322 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f1992a5-6109-411e-b48c-70dabafc820e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:34.235085 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1442/2903] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:34.248120 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:34.249528 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:34.264142 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e715f31d-48a4-4053-97c9-afe8ab37292b service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:34.270477 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:34.271294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:34.271756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:34.272345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:34.281648 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:34.284031 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:34.293829 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1462/2904] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:37.456531 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef4e8-da69-4a2c-b25c-162ced7e65c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.457111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef4e8-da69-4a2c-b25c-162ced7e65c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.457111 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1ef4e8-da69-4a2c-b25c-162ced7e65c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.475925 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fe1ef4e8-da69-4a2c-b25c-162ced7e65c4 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:37.477113 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fe1ef4e8-da69-4a2c-b25c-162ced7e65c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:37.484900 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1443/2905] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:37.498122 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:37.509834 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c5c6d9-7f7a-429a-b333-eee38e44f71d service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:37.515255 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:37.515836 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:37.516113 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:37.516385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:37.524985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:37.526587 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:37.536059 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1463/2906] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:40.550035 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41791b3-2b5d-4f86-b393-e6214303ff07 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.550524 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41791b3-2b5d-4f86-b393-e6214303ff07 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.550635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41791b3-2b5d-4f86-b393-e6214303ff07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.577404 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b41791b3-2b5d-4f86-b393-e6214303ff07 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:40.578838 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b41791b3-2b5d-4f86-b393-e6214303ff07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:40.587606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1444/2907] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:19:40.602365 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:40.613931 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3785bc03-5ce8-4c01-a513-8db540b7a1d9 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:40.619358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:40.619945 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:40.620223 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:40.620521 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:40.629359 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:40.630949 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:40.640366 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1464/2908] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:43.715222 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b62af6-7dca-4693-aae1-8257b62483d5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.715716 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b62af6-7dca-4693-aae1-8257b62483d5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.715829 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b62af6-7dca-4693-aae1-8257b62483d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.735216 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-14b62af6-7dca-4693-aae1-8257b62483d5 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:43.736394 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-14b62af6-7dca-4693-aae1-8257b62483d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:43.744019 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1445/2909] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:43.761073 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:43.772682 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41277bb0-9c5e-4e41-9731-61aa4cd3db3c service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:43.778052 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:43.778643 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:43.778925 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:43.779196 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:43.787161 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:43.788726 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:43.798513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1465/2910] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:19:46.875734 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.876208 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.876312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.896152 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:19:46.897366 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:46.905079 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1446/2911] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:19:46.920673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:46.932394 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be273632-9425-4f0f-a4bf-94c18061c20d service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:46.938000 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:46.938598 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:46.939487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:46.939763 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:46.948242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:46.949842 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:46.959548 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1466/2912] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:52.582740 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:52.584197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:52.596606 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b41096-ac6d-4470-a212-ae578c50af01 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:52.600145 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:52.600737 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:52.601018 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:52.601326 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:52.603059 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:52.616872 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:52.618388 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-920fe958-1450-4118-b331-7cd9fb5bbdb1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:52.629491 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1447/2913] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:52 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:19:53.800746 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:19:53.809879 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd38d7a-96f4-4faf-aba7-52d1eb324c57 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:19:53.813530 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:19:53.814796 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:19:53.815077 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:19:53.815345 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:19:53.817060 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:19:53.831211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:19:53.832621 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd84e66b-abaf-4134-82eb-5e3a30e0b002 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:19:53.843488 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1467/2914] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:19:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:01.037458 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:01.037931 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:01.038061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:01.045130 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=25 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:01.058576 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] MFA Rules not processed for user `998651e3aad144ab9a69e4e2ae45585a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:01.059772 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:01.067430 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1448/2915] 10.222.0.43 () {58 vars in 958 bytes} [Thu Sep 1 05:20:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:03.838673 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=70 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:11.053635 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:13.024679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723be0-5a33-4ba9-a378-81217856697d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:13.025242 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723be0-5a33-4ba9-a378-81217856697d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:13.025358 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7723be0-5a33-4ba9-a378-81217856697d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:13.045364 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f7723be0-5a33-4ba9-a378-81217856697d None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:13.046810 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7723be0-5a33-4ba9-a378-81217856697d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:13.054989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1468/2916] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:13.070923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:13.084751 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67296d-1c91-4bc8-af9f-8a2fbbda43b6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:13.090351 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:13.090950 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:13.091232 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:13.091507 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:13.100288 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:13.101902 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:13.111230 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1449/2917] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:16.309627 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42433-5cff-4b68-a2b1-b4812c65b740 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:16.310173 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42433-5cff-4b68-a2b1-b4812c65b740 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:16.310286 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe42433-5cff-4b68-a2b1-b4812c65b740 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:16.331845 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dbe42433-5cff-4b68-a2b1-b4812c65b740 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:16.333126 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dbe42433-5cff-4b68-a2b1-b4812c65b740 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:16.341123 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1469/2918] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:16.354571 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:16.369741 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d5fb1f-d80d-4b82-8a4c-d624304e007d service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:16.375498 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:16.376102 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:16.376386 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:16.376664 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:16.385959 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:16.387538 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:16.396934 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1450/2919] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:19.394523 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32803c-0533-4b92-ab8e-27e2c144b8db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:19.394994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32803c-0533-4b92-ab8e-27e2c144b8db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:19.394994 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab32803c-0533-4b92-ab8e-27e2c144b8db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:19.414905 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ab32803c-0533-4b92-ab8e-27e2c144b8db None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:19.416084 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ab32803c-0533-4b92-ab8e-27e2c144b8db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:19.423916 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1470/2920] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:19.438299 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:19.450062 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d389d737-d075-4511-832f-82434c4b46d5 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:19.456443 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:19.457033 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:19.457353 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:19.457649 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:19.465744 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:19.467334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1927822a-09df-4a8c-bb25-2ba926fffba6 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:19.476592 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1451/2921] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:22.449981 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240606b-e5e7-4e46-9a73-89e15c7c53ac None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.450855 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240606b-e5e7-4e46-9a73-89e15c7c53ac None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.452021 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4240606b-e5e7-4e46-9a73-89e15c7c53ac None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.454569 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1471/2922] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:20:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:22.461061 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ede6-b519-4540-aa8d-1285515cf2bb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.461735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ede6-b519-4540-aa8d-1285515cf2bb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.461735 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d909ede6-b519-4540-aa8d-1285515cf2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.516082 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d909ede6-b519-4540-aa8d-1285515cf2bb None None] MFA Rules not processed for user `76b44e52d3524340925fd7d7e2273763`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:22.517542 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d909ede6-b519-4540-aa8d-1285515cf2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.526419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1452/2923] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:22.539464 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240606b-e5e7-4e46-9a73-89e15c7c53ac None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.552296 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4240606b-e5e7-4e46-9a73-89e15c7c53ac None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.555242 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d82d1-f080-4cfd-a2b8-e0a36d07655b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.555528 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d82d1-f080-4cfd-a2b8-e0a36d07655b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.555798 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4d82d1-f080-4cfd-a2b8-e0a36d07655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.562149 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.562762 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.563038 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.563304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.571110 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.572718 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.578350 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1b4d82d1-f080-4cfd-a2b8-e0a36d07655b None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:22.579579 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b4d82d1-f080-4cfd-a2b8-e0a36d07655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.581844 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1472/2924] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:22.589319 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1453/2925] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:20:22.603938 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.618977 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29e1c88-be8d-48ca-a3a0-435ab792553d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.624468 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.625067 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.625367 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.625637 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.635072 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.636635 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64281150-8d3b-4761-b404-1779e5b5fa3d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.646812 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1473/2926] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:22.673303 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c12e-aeb9-4f43-9be5-a174d4a74744 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.673884 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c12e-aeb9-4f43-9be5-a174d4a74744 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.674163 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199c12e-aeb9-4f43-9be5-a174d4a74744 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.675543 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1454/2927] 10.222.0.43 () {54 vars in 921 bytes} [Thu Sep 1 05:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 01 05:20:22.680985 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.681304 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.681579 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.720237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] MFA Rules not processed for user `1c86910525fd489eae437f3cedc7443c`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:22.721613 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.730885 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1474/2928] 10.222.0.43 () {58 vars in 1018 bytes} [Thu Sep 1 05:20:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 01 05:20:22.743983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c12e-aeb9-4f43-9be5-a174d4a74744 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.758639 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199c12e-aeb9-4f43-9be5-a174d4a74744 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.762193 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.762784 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.763058 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.763328 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.773425 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.774836 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.785465 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1455/2929] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:22.847458 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:22.848841 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.917419 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad47d8f3-4ed2-4d82-af65-7ef682f20a87 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:22.922380 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:22.922972 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:22.923253 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:22.923526 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:22.925967 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:22.938891 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:22.941687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab37112-7356-4914-8366-0d2c64ba894b service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:22.953041 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1475/2930] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:22 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:24.631537 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:24.640048 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1432028b-37b6-48c5-b7c0-3c2751ac8301 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:24.643715 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '76b44e52d3524340925fd7d7e2273763', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:24.644296 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:24.644594 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:24.644865 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:24.646562 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:24.655846 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:24.657389 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:24.665585 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1456/2931] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:24 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:20:25.730080 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:25.730566 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:25.730681 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:25.750433 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] MFA Rules not processed for user `cf343adbeb5a4274998fc6f26d67b66f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 01 05:20:25.751614 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:20:25.760045 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1476/2932] 10.222.0.50 () {58 vars in 1016 bytes} [Thu Sep 1 05:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 01 05:20:25.774736 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:25.787898 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b487bb-71fc-4ae2-8b60-a03edf4259d3 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:25.793344 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1c86910525fd489eae437f3cedc7443c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:25.793928 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:25.794202 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:25.794472 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:25.802924 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:25.804476 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:25.813620 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1457/2933] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:20:35.745069 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=65 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:35.809489 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=52 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:20:53.634745 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:53.645679 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1a8121-e7b5-4067-a133-a02ca37844b1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:53.650355 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:53.650989 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:53.651269 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:53.651542 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] PATH_INFO: `/v3/users/998651e3aad144ab9a69e4e2ae45585a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:53.652686 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=998651e3aad144ab9a69e4e2ae45585a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:53.654631 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:53.700349 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '998651e3aad144ab9a69e4e2ae45585a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:53.708487 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '998651e3aad144ab9a69e4e2ae45585a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:53.715215 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '998651e3aad144ab9a69e4e2ae45585a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:53.715888 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '998651e3aad144ab9a69e4e2ae45585a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:53.728396 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '998651e3aad144ab9a69e4e2ae45585a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:53.734290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1477/2934] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:20:53 2022] DELETE /identity/v3/users/998651e3aad144ab9a69e4e2ae45585a => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 01 05:20:53.907080 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:20:53.917485 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc4745-cb28-40c4-a293-f5c113cba225 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:20:53.980169 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:20:53.980825 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:20:53.981105 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:20:53.981421 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] PATH_INFO: `/v3/projects/7abd6d0e2d5e474ebdc74882b63447c5` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:20:53.982526 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7abd6d0e2d5e474ebdc74882b63447c5)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:20:53.984448 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:20:54.030336 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7abd6d0e2d5e474ebdc74882b63447c5', 'request_id': 'req-05dca114-071b-474a-a492-8922fa51c121'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:54.036833 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7abd6d0e2d5e474ebdc74882b63447c5', 'request_id': 'req-05dca114-071b-474a-a492-8922fa51c121'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:54.042185 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7abd6d0e2d5e474ebdc74882b63447c5', 'request_id': 'req-05dca114-071b-474a-a492-8922fa51c121'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:54.054227 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] The token cache is being invalidate because project 7abd6d0e2d5e474ebdc74882b63447c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:20:54.054520 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:54.055144 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:20:54.056609 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1458/2935] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:20:53 2022] DELETE /identity/v3/projects/7abd6d0e2d5e474ebdc74882b63447c5 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:21:03.730756 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:04.051334 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:48.231378 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:48.232792 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:48.328743 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41cc7c7-d638-4cc7-a87b-cc631f0beb4e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:48.403379 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:48.403911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:48.404189 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:48.404459 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:48.406280 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:48.420883 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:48.423300 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:48.433290 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1478/2936] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:21:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 01 05:21:51.381778 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:51.383323 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:51.450695 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05dca114-071b-474a-a492-8922fa51c121 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:51.455279 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:51.456027 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:51.456212 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:51.456461 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] PATH_INFO: `/v3/users/1c60b3d40f3f45c2bb3bc283e11ec805` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:51.457623 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c60b3d40f3f45c2bb3bc283e11ec805)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:51.459540 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:51.509711 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c60b3d40f3f45c2bb3bc283e11ec805'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.517852 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c60b3d40f3f45c2bb3bc283e11ec805'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.530636 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c60b3d40f3f45c2bb3bc283e11ec805'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.531370 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c60b3d40f3f45c2bb3bc283e11ec805'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.538879 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c60b3d40f3f45c2bb3bc283e11ec805'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.544725 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1459/2937] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:21:51 2022] DELETE /identity/v3/users/1c60b3d40f3f45c2bb3bc283e11ec805 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:21:51.723439 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:51.733995 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acda2edf-955b-40a3-b206-7add3eb23c7d service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:51.790687 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:51.791237 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:51.791513 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:51.791786 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] PATH_INFO: `/v3/projects/252181fc575c44a6bf6390d770531fb2` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:51.792882 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=252181fc575c44a6bf6390d770531fb2)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:51.794804 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:51.832397 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:51.843152 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '252181fc575c44a6bf6390d770531fb2', 'request_id': 'req-43439c8b-2ae2-4670-b580-524c2694fe60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.850451 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '252181fc575c44a6bf6390d770531fb2', 'request_id': 'req-43439c8b-2ae2-4670-b580-524c2694fe60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.855911 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '252181fc575c44a6bf6390d770531fb2', 'request_id': 'req-43439c8b-2ae2-4670-b580-524c2694fe60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.867004 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] The token cache is being invalidate because project 252181fc575c44a6bf6390d770531fb2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:21:51.867294 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.867924 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:51.869422 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1479/2938] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:21:51 2022] DELETE /identity/v3/projects/252181fc575c44a6bf6390d770531fb2 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:21:51.873436 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:51.874858 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:51.889305 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2bf630d-01d0-4d8b-85cf-7da94f469cf1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:51.951081 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:51.951722 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:51.951999 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:51.952786 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] PATH_INFO: `/v3/users/efad514542c747c4a5b5deef38b447a8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:51.953724 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efad514542c747c4a5b5deef38b447a8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:51.955631 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:51.978419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:21:52.004927 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efad514542c747c4a5b5deef38b447a8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.012197 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efad514542c747c4a5b5deef38b447a8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.024685 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efad514542c747c4a5b5deef38b447a8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.025419 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efad514542c747c4a5b5deef38b447a8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.032819 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efad514542c747c4a5b5deef38b447a8'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.038676 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1460/2939] 10.222.0.43 () {58 vars in 1224 bytes} [Thu Sep 1 05:21:51 2022] DELETE /identity/v3/users/efad514542c747c4a5b5deef38b447a8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:21:52.213141 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:21:52.214595 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:21:52.227293 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43439c8b-2ae2-4670-b580-524c2694fe60 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:21:52.283758 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cf343adbeb5a4274998fc6f26d67b66f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9091867b04ed42e18d85ad30e6815c4c', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:21:52.284385 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:21:52.284663 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:21:52.284934 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] PATH_INFO: `/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:21:52.286078 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a957d8ca0d2f40e086eefbcb7f0e3a9c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:21:52.287961 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:21:52.332653 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a957d8ca0d2f40e086eefbcb7f0e3a9c', 'request_id': 'req-d688199d-2517-4700-82ba-3954cbbdf00c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.339227 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a957d8ca0d2f40e086eefbcb7f0e3a9c', 'request_id': 'req-d688199d-2517-4700-82ba-3954cbbdf00c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.345509 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a957d8ca0d2f40e086eefbcb7f0e3a9c', 'request_id': 'req-d688199d-2517-4700-82ba-3954cbbdf00c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.356211 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] The token cache is being invalidate because project a957d8ca0d2f40e086eefbcb7f0e3a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 01 05:21:52.356499 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.357259 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d688199d-2517-4700-82ba-3954cbbdf00c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 01 05:21:52.358769 dv-cinder-853910-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1480/2940] 10.222.0.43 () {58 vars in 1233 bytes} [Thu Sep 1 05:21:52 2022] DELETE /identity/v3/projects/a957d8ca0d2f40e086eefbcb7f0e3a9c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 01 05:22:02.035204 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:22:02.353305 dv-cinder-853910-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=12,keystone:SELECT=62,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 01 05:23:15.122983 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 01 05:23:15.124572 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:15.192756 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9956f066-441b-46df-9681-28cafd67e161 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 01 05:23:15.251776 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fdc935f85996421c8758edab8f2b7202', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f2f0d34c3c6049fb9a33c816ad607755', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 01 05:23:15.252312 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 01 05:23:15.252596 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 01 05:23:15.252874 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 01 05:23:15.254637 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 01 05:23:15.266367 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 01 05:23:15.267923 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab9560-a170-452b-aa7c-9ba3bccdad43 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 01 05:23:15.277771 dv-cinder-853910-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1461/2941] 10.222.0.43 () {60 vars in 1365 bytes} [Thu Sep 1 05:23:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 01 05:23:25.273547 dv-cinder-853910-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=58 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}